Software Developer - Data at Imc
Job Description
📋 Description
- Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.)
- Build, deploy, and monitor our data processing pipelines (Java, Python, Spark, Flink)
- Collaborate with development teams on data modeling, data ingestion, and capacity planning
- Work with users to ensure data integrity and availability
- Act as a Big Data SME and consult on data-related questions from users and developers
🎯 Requirements
- 5+ years in a mature data engineering environment
- 3+ years building Kafka streaming apps and/or Kafka clusters
- 2+ years building apps/pipelines with Big Data backends (S3, HDFS, Databricks, Iceberg)
- Experience with Spark, Flink or similar tools
- Strong Java, Python, and SQL development skills
- Python-based data-science toolkits experience
- Kubernetes and Docker hands-on experience
- Monitoring with Prometheus, Grafana, Alert Manager, Alerta, OpsGenie
- Strong statistical analysis skills
- Root-cause analysis and troubleshooting
- Unix scripting (bash, Python)
More Current Jobs at Imc
Apply to other open positions at Imc
