Update README.md
Browse files
README.md
CHANGED
|
@@ -29,7 +29,7 @@ A small convolutional neural network, written and trained from scratch in PyTorc
|
|
| 29 |
## Data
|
| 30 |
|
| 31 |
- 297 spectrogram images: 101 background, 99 helicopter, 97 drone.
|
| 32 |
-
- Spectrograms were generated from
|
| 33 |
- Random 60/20/20 train/validation/test split (`random_state=42`), about 178 / 59 / 60 images.
|
| 34 |
|
| 35 |
## Training
|
|
@@ -40,13 +40,13 @@ A small convolutional neural network, written and trained from scratch in PyTorc
|
|
| 40 |
|
| 41 |
## Results (60 held-out test spectrograms)
|
| 42 |
|
| 43 |
-
- Test accuracy:
|
| 44 |
-
- Weighted F1:
|
| 45 |
- Per-class one-vs-rest ROC-AUC: helicopter 1.00, drone 0.97, background 0.96
|
| 46 |
|
| 47 |
## Limitations
|
| 48 |
|
| 49 |
-
- Small dataset
|
| 50 |
- Training loss is very low while validation accuracy is lower, which suggests overfitting. No data augmentation or regularisation was used.
|
| 51 |
- The split is random at image level. [State whether all spectrograms come from separate recordings. If some share a source recording, say so: near-duplicate clips in train and test would inflate the scores, and splitting by recording is the planned next step.]
|
| 52 |
- Not tested on recordings from new environments, microphones or noise conditions.
|
|
|
|
| 29 |
## Data
|
| 30 |
|
| 31 |
- 297 spectrogram images: 101 background, 99 helicopter, 97 drone.
|
| 32 |
+
- Spectrograms were generated from dataset provided by the London Defence Hackathon community on GitHub
|
| 33 |
- Random 60/20/20 train/validation/test split (`random_state=42`), about 178 / 59 / 60 images.
|
| 34 |
|
| 35 |
## Training
|
|
|
|
| 40 |
|
| 41 |
## Results (60 held-out test spectrograms)
|
| 42 |
|
| 43 |
+
- Test accuracy: 86.7%
|
| 44 |
+
- Weighted F1: 0.86 (precision 0.89, recall 0.86%)
|
| 45 |
- Per-class one-vs-rest ROC-AUC: helicopter 1.00, drone 0.97, background 0.96
|
| 46 |
|
| 47 |
## Limitations
|
| 48 |
|
| 49 |
+
- Small dataset of 297 recordings and a small test set (60 images) so these figures are indicative rather than precise.
|
| 50 |
- Training loss is very low while validation accuracy is lower, which suggests overfitting. No data augmentation or regularisation was used.
|
| 51 |
- The split is random at image level. [State whether all spectrograms come from separate recordings. If some share a source recording, say so: near-duplicate clips in train and test would inflate the scores, and splitting by recording is the planned next step.]
|
| 52 |
- Not tested on recordings from new environments, microphones or noise conditions.
|