About Polymath
Polymath — Polymath uses machine learning to convert any music library (e.g from Hard-Drive or YouTube) into a music production sample-library. The tool automatically separates songs into stems (beats, bass, etc.), quantizes them to the same tempo and beat-grid (e.g. 120bpm), analyzes musical structure (e.g. verse, chorus, etc.), key (e.g C4, E3, etc.) and other infos (timbre, loudness, etc.), and converts audio to midi. The result is a searchable sample library that streamlines the workflow for music producers, DJs, and ML audio developers.
Top use cases
- Combining elements from different songs to create new compositions.
- Creating mash-up DJ sets.
- Creating large music datasets for training generative models.
Built for
Key features
- Automatic music separation into stems (beats, bass, etc.)
- Quantization to a unified tempo and beat-grid
- Musical structure analysis (verse, chorus, etc.)
- Key detection
- Audio to MIDI conversion
- Searchable sample library
Pros & cons
Pros
- Streamlines music production workflow.
- Simplifies creation of sample libraries.
- Enables easy discovery of related tracks.
- Offers automatic audio analysis and processing.
- Supports GPU acceleration for faster processing (native setups).
Cons
- Requires specific Python version (>=3.7 and <=3.10).
- GPU support in Docker is forthcoming.
- Audio2Midi model gives mixed results with drums/percussion.
- Generated Midi Files are currently always 120BPM and need to be time adjusted in your DAW.
Frequently asked questions
What software do I need to have installed?
You need to have ffmpeg installed on your system.
How do I install Polymath?
You need python version >=3.7 and <=3.10. From your terminal run: git clone https://github.com/samim23/polymath, cd polymath, pip install -r requirements.txt
How do I reset the Polymath library?
The database is stored in the folder "/library/database.p". To reset everything, simply delete it.
Related tools
AI-powered app for musicians to separate tracks, remove vocals, and remix songs.
An end-to-end music production platform with AI mastering, distribution, plugins, and courses.
Kits AI provides studio-quality AI music tools for producers, including voice cloning and mastering.
