Home page for the log-to-sql project.
The first thing to come out of this project is a perl program to move apache access logs into a SQL database (apache_log_sql.pl).
This project is mainly an intellectual exercise in creating and publishing a small piece of open-source software. It is as much about offering up something useful as it is about teaching me about software project management.
You can also check out the author at www.rothrock.org
Here are some links to get you started should you choose to try to use this little program.
What do I have planned for the future?
- Make sure that all the file operations are transacted.
- support MySQL
- try porting it to C
- Experiment with other sources of CLF files (like maybe streaming servers)
- create extraction tools to generate synthetic text logs from a subset of database rows.
- Develop some canned queries for easier reporting.
