Big Data Engineer jobs

**Attention Data Wizards!****What You'll Do:**- Build and maintain Big Data Pipelines like a boss ?- Work your magic with Terraform, Python, SQL, and more ?- Dive into the world of ETL, cloud platforms, and collaboration tools ??- Bring your AWS expertise to the table and level up our data game ??**What You'll Need:**- Skills in Terraform, Python, SQL, Py Spark, and Docker ??- Experience with ent...

Data Engineer (CPT/JHB Hybrid)IT - Analyst, Data ManagementCape Town - Western Cape Johannesburg - GautengENVIRONMENT: CREATE and implement scalable data architectures, develop and optimize ETL processes while ensuring the availability, quality and integrity of data throughout the organization of a leading Group operating a portfolio of leading responsible travel companies seeking a highly skille...

We are looking for a hardworking and enterprising individual looking for a challenge. If you're excited by the idea of helping us Scale across South Africa and the rest of Africa. If you have an insatiable desire to Learn and Grow every single day. Then here's your chance !! Responsibilities Building and maintaining our data infrastructure. Building and automating reports and dashboards for the e...

A Global company with a focus on innovation topics as well as comprehensive IT solutions such as Development and Operations for SAP, JAVA, Azure, Cloud is looking for an Azure Data Engineer. The unique positioning gives a deep insight into the compliance and IT Methodology processes within the group and offer internal clients an extended warranty due to their vested interests in the success and s...

Our client requires the services of a Data Engineer/Scientist ( Expert) - Midrand/Menlyn/Rosslyn/Home Office rotation. Amazing brand with cutting-edge technology Excellent teams in Global team collaboration High work-life balance with Flexible hours Agile working environment POSITION: Contract until December 2026 EXPERIENCE: 8 Years related working experience. COMMENCEMENT: As soon as possible QU...

About the job AWS Data Engineer (Contract) - Gauteng/Hybrid - ISB2210675/2050 Our client requires the services of a Data Engineer/Scientist (Expert) - Midrand/Menlyn/Rosslyn/Home Office rotation. Amazing brand with cutting-edge technology Excellent teams in Global team collaboration High work-life balance with Flexible hours Agile working environment POSITION: Contract until December 2026EXPERIEN...

Our client requires the services of a Data Engineer/Scientist (Entry) - Midrand/Menlyn/Rosslyn/Home Office rotation.Amazing brand with cutting-edge technologyExcellent teams in Global team collaborationHigh work-life balance with Flexible hoursAgile working environmentPOSITION: Contract until December 2026EXPERIENCE: 2-4 Years related working experience.COMMENCEMENT: As soon as possibleQUALIFICAT...

Overview Hire Resolve s client is urgently seeking the expertise of an experienced Backend Data Engineer in Cape Town (Hybrid).Responsibilities Collaborate with cross-functional teams to define system requirements, design solutions, and ensure the delivery of high-quality software.Advocate for best practices in Data processing and API designs, systems architectures, automation, and system scalabi...

Overview Hire Resolve s client is urgently seeking the expertise of an experienced Backend Data Engineer in Cape Town (Hybrid). Responsibilities Collaborate with cross-functional teams to define system requirements, design solutions, and ensure the delivery of high-quality software. Advocate for best practices in Data processing and API designs, systems architectures, automation, and system scala...

Our client requires the services of a Software Engineer (Advanced) - Midrand/Menlyn/Rosslyn/Home Office Rotation Amazing brand with cutting edge technology Excellent teams in Global team collaboration High work-life balance with Flexible hours Agile working environment POSITION: Contract until December 2026 EXPERIENCE: 4-6 Years related working experience. COMMENCEMENT: As soon as possible ROLE: ...

What to expect If you are looking for an opportunity to work with data in a different and connected way, you might be the Data Engineer we are looking for! If you are an innovative Data Engineer, that likes connecting the dots in Data together and building high-performance Data Platforms that service multiple Data and Business Services, joining our team might just be the challenge you are looking...

What to expectIf you are looking for an opportunity to work with data in a different and connected way, you might be the Data Engineer we are looking for! If you are an innovative Data Engineer, that likes connecting the dots in Data together and building high-performance Data Platforms that service multiple Data and Business Services, joining our team might just be the challenge you are looking ...

ENVIRONMENT: CREATE and implement scalable data architectures, develop and optimize ETL processes while ensuring the availability, quality and integrity of data throughout the organization of a leading Group operating a portfolio of leading responsible travel companies seeking a highly skilled Data Engineer. You will be responsible for developing, maintaining, and optimizing the data warehouse, d...

Responsibilities: Utilize Enterprise Collaboration tools such as Confluence and JIRA to facilitate communication and collaboration within the team. Develop technical documentation and artifacts to support data engineering processes and initiatives. Work with various data formats including Parquet, AVRO, JSON, XML, and CSV. Utilize Data Quality Tools such as Great Expectations to ensure data accur...

The purpose of this role is to lead the technical delivery team, using experience to deliver right sized and well architected solutions in order to meet targets. The successful candidate will be expected to use their experience working in Azure to understand the available technology choices and selectively implement services safely and securely. As well as demonstrable experience working with the...

Reference: JHB009269-KS-1 Are you ready to fuel innovation in the motor industry through cutting-edge data solutions? Our client is seeking a dynamic Data Engineer to accelerate their enterprise collaboration and data quality initiatives. Responsibilities: Utilize Enterprise Collaboration tools such as Confluence and JIRA to facilitate communication and collaboration within the team. Develop tech...

Reference: JHB009271-BM-1 Contract Starts: 01.06.2024 Contract Ends: 31.12.2026 Location: Midrand/Menlyn/Rosslyn/Home Office rotation ESSENTIAL SKILLS REQUIREMENTS: e.g. Technical Skills / Technology Terraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash Cloud Data Hub (CDH) CDEC Blueprint Experience in working with Enterprise Collaboration t...

ESSENTIAL SKILLS REQUIREMENTS: Understand the relevant Aftersales business processes: Logistics, Sales, Warehouse and Extended Warehouse Management SAP Analytics Cloud Eclipse SAP BW 7.5 Data Modelling and BEX skills essential SAP ABAP, AMDP competence essential SAP BO experience (AFO & WEBI) essential Modules SAP BW SAP BO ITSMADVANTAGEOUS SKILLS REQUIREMENTS: Problem solving capabilities Abilit...

RESPONSIBILITIESYou will serve as a custodian of data, ensuring that it is shared securely and in compliance with information classification requirements on a need-to-know basis.Designing, implementing, and maintaining Big Data Pipelines using BMW Data Platforms.Collaborating with cross-functional teams to understand data requirements and develop scalable solutions.Ensuring data accuracy and inte...

RESPONSIBILITIES You will serve as a custodian of data, ensuring that it is shared securely and in compliance with information classification requirements on a need-to-know basis. Designing, implementing, and maintaining Big Data Pipelines using BMW Data Platforms. Collaborating with cross-functional teams to understand data requirements and develop scalable solutions. Ensuring data accuracy and ...

Seeking More Than Just a Job? Embrace a New Chapter with iOCO Infrastructure Services. We are seeking a Cloud Engineer to join our team. As a Cloud Engineer you'll be responsible for designing, implementing, and maintaining cloud-based infrastructure and services to support an organization's IT needs  What you†ll do: Maintenance, and support of our VMware platform which makes up our iOCO Cloud...

Reference: NPs000019-KS-1 Our client in the motor industry is looking to employ a Senior AWS Data Engineer. As a Big Data Engineer, you will be responsible for building and maintaining robust Big Data Pipelines using our client's Data Platforms. RESPONSIBILITIES You will serve as a custodian of data, ensuring that it is shared securely and in compliance with information classification requirement...

Machine Learning EngineerJohannesburgPermanentAn entrepreneurial, and forward-thinking company specialises in utilizing geospatial data and technologies to help clients enhance their operational efficiencies and increase profitability. They offer tailored data, insights, and innovative products across various industries, aiming to convert raw data into practical business insights. With expertise ...

A fantastic opportunity for an AWS Data Engineer to join a team of specialists developing the next generation of software systems. You will be responsible in performing thorough testing and data validation to ensure the accuracy of data transformations. Core understanding of and working experience with: Terraform Python 3x SQL - Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Po...