Most Difficult Part of Training a Neural Network, According to AI/ML Developers

Survey Q: What is the hardest part of training a neural network?

Tuning hyperparameters
44.4%
Finding a large enough data set
43.8%
Development time
42.5%
Overfitting or underfitting
41.9%
Vanishing and exploding gradients
41.4%
Computational requirements
34.1%
Source: Evans Data Corp. “AI & Machine Learning Survey Report 23.2,” 2023; note: fielded online among qualified AI and machine learning developers worldwide who are currently working with neural network architectures or will within the next 12 months (n=923); respondents could select up to 3 responses, so percentages will not total 100%