“Best Places to Work.” We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer..., PySpark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential...
with ETL/ELT using Azure Synapse pipelines, Azure Data Factory, or comparable tools (AWS Glue, Google Cloud Dataflow, Apache... Leave Key Responsibilities: Monitor established data pipelines and scheduled jobs; build and validate basic ETL/ELT...
, develop and maintain scalable data pipelines and systems on AWS Implement data integration and ETL processes using PySpark... with AWS services such as S3, Redshift, Lambda and Glue Strong understanding of data warehousing concepts and ETL processes...
and technical leads to implement data models and ETL/ELT workflows based on business requirements. · Data Quality & Testing: Write... records highly desired Required technical expertise : · Proficiency in Apache Spark (PySpark or Scala) for data processing...
. Develop advanced ETL processes for diverse data sources. Data Governance and Quality Management - Establish and enforce data..., Lambda, SQS, SNS, Glue, RDS AWS services. Excellent proficiency in Python, Pyspark, advanced SQL for ingestion frameworks...
advanced ETL processes for diverse data sources. Data Governance, Security & Quality Management - Establish and enforce data..., Snowflake. Experience using S3, Lambda, SQS, SNS, Glue, RDS AWS services. Excellent proficiency in Python, Pyspark, advanced...
pipelines for efficient data processing and integration for real-time and batch-processing. Implement and optimize ETL processes.... Proficiency in Python, Pyspark, advanced SQL for ingestion frameworks and automation. Hands-on data orchestration experience...
advanced ETL processes for diverse data sources Data Governance and Quality Management – Drive, establish and enforce data..., AZ This position is responsible for architecting, designing, implementing, and optimizing complex data solutions. This role leads the...
administration, provisioning, and use of cloud technologies (i.e. AWS) particularly with application of data science approaches...Job Description: The Contractor shall work with data scientists and data engineers to architect, operate...
-on experience building and maintaining dbt data models and transformation pipelines. Proficiency with AWS Glue, including ETL... and processing using PySpark and AWS Glue. Apply software engineering best practices-including version control, testing...
-on experience building and maintaining dbt data models and transformation pipelines. Proficiency with AWS Glue, including ETL... and processing using PySpark and AWS Glue. Apply software engineering best practices—including version control, testing...
skills in Python/PySpark/Scala/Java and SQL. Solid experience with cloud databases, data modeling concepts, ETL processes..., and at least one public cloud platform (Oracle Cloud, AWS, Azure, or Google Cloud), especially for data services. Good understanding of data...
PySpark / Spark SQL · Implement data ingestion from on-prem and cloud sources into Databricks (landing → bronze → silver...) · Adapt existing ETL logic to align with a new enterprise data model, identifying gaps and required transformation changes...
, and maintaining ETL/ELT pipelines using Python, PySpark, and related tools. SQL and Data Warehousing: Strong SQL skills Cloud... Platforms: Hands-on experience with cloud services (AWS, Azure, or GCP) and cloud-native data tools. Big Data...
, and cleanliness Work within the cloud environment (AWS, Azure) and related big-data technologies (e.g., Apache Spark/PySpark...) Solid experience with SQL and Apache Spark/PySpark Familiarity with cloud platforms (AWS and/or Azure) and scalable data...
will be REJECTED. Job Title: Technology Lead - Engineering | Data On Cloud - Platform | AWS -- ETL-AWS Lead Engineer Work Location... data models on AWS Cloud leveraging Redshift, RDS, and S3. ⦁ Implement ETL/ELT workflows and PySpark jobs for data...
Apache Spark ecosystem. Proficient in building data pipelines using PySpark/Scala and managing data in Delta Lake format.... Strong experience working with cloud data platforms (GCP preferred, or AWS/Azure). Familiarity with GCP Storage principles...
. Design and deploy automated solutions for building, testing, monitoring, and deploying ETL data pipelines in a continuous.... Complete the full lifecycle of ETL/ELT development, including design, mappings, data transformations, scheduling, and testing...
integration tools like Informatica and AWS services for Data Integration. Responsibilities for Data Platform Engineer... Spark. Experience with working on big data processing platforms like Apache Spark, building ETL code using Apache pyspark...
and privacy controls Orchestrate multimodal pipelines using scalable frameworks (e.g., Apache Spark, PySpark) for automated ETL.... Someone who has experience with ML and Data Science and has been a Software Engineer in the past and now moved to Gen...