Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,4 @@
|
|
|
|
|
| 1 |
license: mit
|
| 2 |
library_name: pytorch
|
| 3 |
tags:
|
|
@@ -41,16 +42,17 @@ A small convolutional neural network, written and trained from scratch in PyTorc
|
|
| 41 |
## Results (60 held-out test spectrograms)
|
| 42 |
|
| 43 |
- Test accuracy: 86.67%
|
| 44 |
-
- Weighted F1: 0.87 (precision 0.87, recall 0.
|
| 45 |
-
- Per-class one-vs-rest ROC-AUC: helicopter
|
| 46 |
|
| 47 |
## Limitations
|
| 48 |
|
| 49 |
- Small dataset of 297 recordings and a small test set (60 images) so these figures are indicative rather than precise.
|
| 50 |
- Training loss is very low while validation accuracy is lower, which suggests overfitting. No data augmentation or regularisation was used.
|
| 51 |
-
-
|
|
|
|
| 52 |
- Not tested on recordings from new environments, microphones or noise conditions.
|
| 53 |
-
-
|
| 54 |
|
| 55 |
## Usage
|
| 56 |
|
|
|
|
| 1 |
+
---
|
| 2 |
license: mit
|
| 3 |
library_name: pytorch
|
| 4 |
tags:
|
|
|
|
| 42 |
## Results (60 held-out test spectrograms)
|
| 43 |
|
| 44 |
- Test accuracy: 86.67%
|
| 45 |
+
- Weighted F1: 0.87 (precision 0.87, recall 0.87)
|
| 46 |
+
- Per-class one-vs-rest ROC-AUC: helicopter 0.99, drone 0.96, background 0.94
|
| 47 |
|
| 48 |
## Limitations
|
| 49 |
|
| 50 |
- Small dataset of 297 recordings and a small test set (60 images) so these figures are indicative rather than precise.
|
| 51 |
- Training loss is very low while validation accuracy is lower, which suggests overfitting. No data augmentation or regularisation was used.
|
| 52 |
+
- Background clips are sometimes misclassified as helicopter.
|
| 53 |
+
- The split is random at image level.
|
| 54 |
- Not tested on recordings from new environments, microphones or noise conditions.
|
| 55 |
+
- This is a baseline model for problem-solving demonstration. Not for safety-critical use.
|
| 56 |
|
| 57 |
## Usage
|
| 58 |
|