Create a log aggregation system that receives logs from multiple applications, stores them efficiently, and provides search and analytics capabilities.

Project Checklist

• Create API endpoint to receive log entries
• Store logs in database with indexing
• Implement log search and filtering
• Add log level filtering (info, warn, error)
• Create log retention policies
• Add basic log aggregation and statistics

Bonus Project Checklist Items

• Integrate with Elasticsearch for HARD search
• Implement log parsing and structured logging
• Add real-time log streaming
• Create log visualization dashboards
• Implement log alerting for error thresholds
• Add log correlation across services

Inspiration (Any companies/libraries similar)

• ELK Stack (Elasticsearch, Logstash, Kibana)
• Datadog
• Splunk

Hint/Code snippet to start

app.post('/logs', async (req, res) => {
  const { level, message, service, metadata } = req.body;
  const logEntry = {
    timestamp: new Date(),
    level,
    message,
    service,
    metadata
  };
  await db.logs.insert(logEntry);
  res.status(201).json({ success: true });
});

app.get('/logs', async (req, res) => {
  const { level, service, startDate, endDate } = req.query;
  const logs = await db.logs.find({
    level,
    service,
    timestamp: { $gte: startDate, $lte: endDate }
  });
  res.json(logs);
});