Big Data Engineer
About the role
In this role, you'll apply your expertise to help train next generation AI systems. Your work will shape how models learn, reason, and perform through high quality, real world input.
What you'll do
- Design, build, and maintain scalable big data pipelines and architectures to support robust data solutions.
- Collaborate with cross functional teams to understand and deliver on data requirements and business objectives.
- Implement data integration, transformation, and processing solutions using Python and relevant big data technologies.
- Develop, manage, and optimize distributed databases and storage systems for efficiency and reliability.
- Monitor, troubleshoot, and enhance data systems to ensure high availability and performance.
- Enforce data quality, security, and governance standards across all solutions.
- Document solutions and communicate complex technical concepts effectively, both in writing and verbally.
Requirements
- Proven expertise in big data engineering with hands on experience building and maintaining large scale data pipelines.
- Advanced proficiency in Python for data processing, automation, and integration.
- Deep understanding of relational and NoSQL databases, including optimization and management techniques.
- Experience with distributed data processing frameworks (e.g., Hadoop, Spark, Flink).
- Strong foundation in data modeling, ETL processes, and data warehousing principles.
- Excellent written and verbal communication skills, with the ability to convey technical ideas clearly to both technical and non technical stakeholders.
- Detail oriented, proactive, and self motivated, thriving in remote and autonomous work environments.
- Preferred: Prior experience in fast paced or startup like environments supporting global teams.
- Preferred: Expertise with cloud based big data platforms (e.g., AWS, GCP, Azure).
- Preferred: Familiarity with machine learning operations and data science workflows is a plus.
About micro1
micro1 is a data lab that helps AI labs and large companies train AI models and agents. It finds and checks skilled people from many fields, like law, medicine, finance and coding, to produce the training data that makes AI work better.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.