FisayoF commited on
Commit
b649a34
·
verified ·
1 Parent(s): ed2020b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -29,7 +29,7 @@ A small convolutional neural network, written and trained from scratch in PyTorc
29
  ## Data
30
 
31
  - 297 spectrogram images: 101 background, 99 helicopter, 97 drone.
32
- - Spectrograms were generated from [source audio: where the recordings came from, and the tool or settings used to convert them].
33
  - Random 60/20/20 train/validation/test split (`random_state=42`), about 178 / 59 / 60 images.
34
 
35
  ## Training
@@ -40,13 +40,13 @@ A small convolutional neural network, written and trained from scratch in PyTorc
40
 
41
  ## Results (60 held-out test spectrograms)
42
 
43
- - Test accuracy: [xx.x]%
44
- - Weighted F1: [0.xx] (precision [0.xx], recall [0.xx])
45
  - Per-class one-vs-rest ROC-AUC: helicopter 1.00, drone 0.97, background 0.96
46
 
47
  ## Limitations
48
 
49
- - Small dataset, and a small test set (60 images), so these figures are indicative rather than precise.
50
  - Training loss is very low while validation accuracy is lower, which suggests overfitting. No data augmentation or regularisation was used.
51
  - The split is random at image level. [State whether all spectrograms come from separate recordings. If some share a source recording, say so: near-duplicate clips in train and test would inflate the scores, and splitting by recording is the planned next step.]
52
  - Not tested on recordings from new environments, microphones or noise conditions.
 
29
  ## Data
30
 
31
  - 297 spectrogram images: 101 background, 99 helicopter, 97 drone.
32
+ - Spectrograms were generated from dataset provided by the London Defence Hackathon community on GitHub
33
  - Random 60/20/20 train/validation/test split (`random_state=42`), about 178 / 59 / 60 images.
34
 
35
  ## Training
 
40
 
41
  ## Results (60 held-out test spectrograms)
42
 
43
+ - Test accuracy: 86.7%
44
+ - Weighted F1: 0.86 (precision 0.89, recall 0.86%)
45
  - Per-class one-vs-rest ROC-AUC: helicopter 1.00, drone 0.97, background 0.96
46
 
47
  ## Limitations
48
 
49
+ - Small dataset of 297 recordings and a small test set (60 images) so these figures are indicative rather than precise.
50
  - Training loss is very low while validation accuracy is lower, which suggests overfitting. No data augmentation or regularisation was used.
51
  - The split is random at image level. [State whether all spectrograms come from separate recordings. If some share a source recording, say so: near-duplicate clips in train and test would inflate the scores, and splitting by recording is the planned next step.]
52
  - Not tested on recordings from new environments, microphones or noise conditions.