Junior Data Engineer Job at Recruitment Room, Egypt

YWpjY25MNnRKako3TE5xZW9yV0ZXbG1tT3c9PQ==
  • Recruitment Room
  • Egypt

Job Description

What we are looking for

Were looking for a candidate with a foundational understanding of data engineering concepts and handson experience with relevant technologies. This role provides the opportunity to grow into a senior data engineering position contributing to innovative cloudbased projects.

What does the job involve

  • Data Pipeline Development: Assist in implementing and maintaining scalable data pipelines for ingesting processing and transforming large volumes of data from various sources using tools such as Databricks Python and PySpark.
  • Data Modeling: Assist in designing data models and schemas for efficient storage retrieval and analysis of structured and unstructured data.
  • ETL Processes : Develop and automate ETL workflows to extract data from diverse sources transform it into usable formats and load it into data warehouses data lakes or lakehouses.
  • Big Data Technologies: Utilize big data technologies such as Spark Kafka and Flink for distributed data processing and analytics.
  • Cloud Platforms: Collaborate with the team to deploy data solutions on cloud platforms such as AWS Azure or Google Cloud Platform (GCP) leveraging cloudnative services for data storage processing and analytics.
  • Data Quality and Governance: Implement data quality checks validation processes and data governance policies to ensure accuracy consistency and compliance with regulations.
  • Monitoring and Troubleshooting: Monitor data pipelines and assist in troubleshooting and resolving datarelated issues.
  • DevOps: Commit code to version control.
  • Collaboration: Collaborate with crossfunctional teams including data scientists analysts and software engineers to understand requirements and deliver datadriven solutions.
  • Documentation: Create and maintain technical documentation including data architecture diagrams ETL workflows and system documentation to facilitate understanding and maintainability of data solutions.
  • Best Practices : Continuously learn and apply best practices in data engineering and cloud computing.

Qualifications

  • Programming Languages: Experience with Python Java Scala or SQL for data manipulation and scripting.
  • Big Data Technologies: Experience with Databricks Spark Kafka and Flink.
  • Version Control : Experience with systems like Git.
  • Cloud Platforms: Familiarity with AWS Azure or GCP services.
  • SQL: Proficiency in SQL for database management and querying.
  • Apache Spark: Knowledge of Apache Spark for distributed data processing.
  • Modern Data Architectures : Exposure to modern data architectures such as lakehouse.
  • ETL Tools: Knowledge of ETL tools and technologies such as Apache Airflow Informatica or Talend.
  • Cl oud Data Tools : Familiarity with cloud data services like AWS S3 EMR Redshift Glue Azure Data Factory Databricks BigQuery Dataflow and Dataproc.

Benefits

Competitive Salary

Location

Remote Egypt Kenya South Africa Nigeria

Job Tags

Full time, Remote job,

Similar Jobs

The Hellickson Team

Licensed Transaction Coordinator Job at The Hellickson Team

Were looking for a driven transaction coordinator to manage contracts throughout the entire home selling and buying process. Youd be responsible for overseeing transactions from start to finish to ensure offers and counteroffers are approved for a smooth and successful... 

McDonald's

Crew Team Member Job at McDonald's

 ...This job posting is for a position in a restaurant owned and operated by an independent franchisee and not McDonalds USA. This franchisee owns a license to use McDonalds logos and food products, for example, when running the restaurant. However, this franchisee is a... 

HireNow Staffing Inc

OR RNsRegistered Nurses Job at HireNow Staffing Inc

 ...of highly skilled and motivated OR and OR Circulating RNs to become part of our clients team in Rochester New York. As a premier healthcare staffing agency we are committed to delivering topquality healthcare professionals to institutions throughout the United States. Our... 

Get It Recruit - Educational Services

FPV Drone Pilot/Instructor - Remote | WFH Job at Get It Recruit - Educational Services

We're excited to welcome a skilled and experienced Drone Pilot/Instructor to our team! If you're passionate about FPV (First Person View) drone flying and have a deep understanding of FPV systems, components, and flight theory, this is the perfect role for you. This part... 

PwC

Google Cloud Data Engineer [No-Code / Low-Code]-Manager Save for Later Remove job Job at PwC

 ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques...  ...to lead and deliver value at this level include but are not limited to:...  ...does not intend to hire experienced or entry level job seekers who will need, now...