🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Cookies & analytics consent
We serve candidates globally, so we only activate Google Tag Manager and other analytics after you opt in. This keeps us aligned with GDPR/UK DPA, ePrivacy, LGPD, and similar rules. Essential features still run without analytics cookies.
Read how we use data in our Privacy Policy and Terms of Service.
🤖 15+ AI Agents working for you. Find jobs, score and update resumes, cover letter, interview questions, missing keywords, and lots more.
Arrow Components • Banha, Al Qalyubiya, Egypt
Role & seniority: Data Automation Engineer, entry to mid level (1+ years experience)
Stack/tools: Python, Shell/other scripting; Java/Scala; ETL tools and frameworks (Apache Spark, AWS Glue); data automation tools (Airflow, Luigi); cloud platforms (AWS, Azure, GCP)
Develop and maintain automated data pipelines for ingesting, processing, and storing structured and unstructured data (real-time and batch)
Implement data quality checks, monitoring, and issue remediation; ensure data consistency, accuracy, and reliability
Collaborate across data teams; document data processes, architecture, and code; optimize data processes for performance and scalability; support ML/analytics data needs
1+ years in data engineering, automation, or related field
Strong understanding of data pipelines and data lifecycle management
Proficiency in scripting (Python, Shell) and experience with ETL/automation tools
Experience with cloud data processing (AWS/Azure/GCP) and knowledge of data warehousing and data quality methodologies
Experience with Airflow, Luigi, or other workflow orchestration tools
Familiarity with Apache Spark and AWS Glue
Security/compliance awareness related to data
Location & work type: EG-Banha, Egypt (EI Corniche Street); Full-time
Position
Data Automation Engineer
Job Description
As a Data Automation Engineer, you will play a crucial role in developing and maintaining automated data processing systems. You will work closely with data analysts, and other stakeholders to design, implement, and optimize data pipelines, ensuring the efficient and accurate flow of data throughout the organization.
What You'll Do
Develop and implement automated data pipelines for ingesting, processing, and storing structured and unstructured data. Integrate data from various sources in both real-time and batch mechanisms and perform transformations to ensure consistency, accuracy, and reliability. Implement data quality checks and monitoring mechanisms to identify and address issues proactively. Write code and scripts for automation of data processes using languages such as Python, Java, or Scala. Leverage ETL (Extract, Transform, Load) tools and frameworks [Apache spark, AWS Glue] for efficient data processing. Collaborate with other intelligent data teams. Ensure seamless data flow for machine learning and analytics applications. Implement monitoring systems to track data pipeline performance and identify areas for optimization. Continuously optimize data processes for efficiency and scalability. Document data processes, system architecture, and codebase for knowledge sharing and future reference. Keep documentation up-to-date with any changes or enhancements to the data infrastructure. Implement and adhere to data security and compliance standards. Collaborate with security teams to ensure data protection and privacy.
You're a Perfect Fit If You Have
1+ years of experience in data engineering, automation, or a related field. Strong understanding of data pipelines and data lifecycle management. Proficiency in scripting languages like Python, Shell, or similar. Experience with data automation tools (Airflow, Luigi, etc.) a plus. Excellent analytical and problem-solving skills. Strong communication and collaboration skills to work effectively across teams. Knowledge with cloud platforms (AWS, Azure, GCP) for data processing.
Knowledge of data warehousing and data quality methodologies
EG-Banha, Egypt (EI Corniche Street)
Time Type
Full time
Job Category
Information Technology Show more Show less