Session 6 : Bone Surface Modification Dataset Synthesis for Computer Vision Models Using LoRA Tuned Latent Diffusion Models
Presentation Type
Invited
Student
No
Abstract
This research explored the use of generative artificial intelligence to augment the training dataset of bone surface modification images for improving the classification of archaeological artifacts using computer vision. A foundational dataset of existing bone surface modification examples was leveraged to train a generative diffusion model, which was fine-tuned using Low Rank Adaptation (LoRA). This model was then employed to generate synthetic bone surface modification images which were incorporated into a computer vision application designed to classify artifacts based on whether the bone surface modifications were associated with bones containing meat or bones without meat. The study demonstrated that synthetic datasets can significantly enhance model performance, particularly for models trained on smaller, underperforming datasets. Notably, combining the original dataset with the generated synthetic data led to improved accuracy and F1 scores, highlighting the value of generative AI in overcoming limitations of limited real-world data in archaeological applications.
Keywords: dataset synthesis, low-rank adaptation, latent diffusion model, bone surface modification, generative A.I.
Start Date
2-7-2025 11:00 AM
End Date
2-7-2025 12:00 PM
Session 6 : Bone Surface Modification Dataset Synthesis for Computer Vision Models Using LoRA Tuned Latent Diffusion Models
Pasque (Room 255)
This research explored the use of generative artificial intelligence to augment the training dataset of bone surface modification images for improving the classification of archaeological artifacts using computer vision. A foundational dataset of existing bone surface modification examples was leveraged to train a generative diffusion model, which was fine-tuned using Low Rank Adaptation (LoRA). This model was then employed to generate synthetic bone surface modification images which were incorporated into a computer vision application designed to classify artifacts based on whether the bone surface modifications were associated with bones containing meat or bones without meat. The study demonstrated that synthetic datasets can significantly enhance model performance, particularly for models trained on smaller, underperforming datasets. Notably, combining the original dataset with the generated synthetic data led to improved accuracy and F1 scores, highlighting the value of generative AI in overcoming limitations of limited real-world data in archaeological applications.
Keywords: dataset synthesis, low-rank adaptation, latent diffusion model, bone surface modification, generative A.I.