, streaming, and AI. Cloudera Data Engineering (CDE) is our next-generation, cloud-native service built on Apache Spark... Spark ecosystem and surrounding cloud-native technologies. Solve Complex Challenges: Address non-routine technical...
such as Collibra, Alation, or Apache Atlas. Team Leadership & Organizational Influence Lead, mentor, and scale a high-performing... storage, and hybrid architectures. Fluency in SQL, Python, Java, or Scala for data transformation and pipeline automation...
and AI solutions using Scala/Java, Python, Spring Boot, REST/gRPC APIs, SQL/NoSQL databases, and modern UI frameworks such as Angular... in modern Data Engineering including Spark (Structured Streaming), Databricks, Kafka, Airflow, DBT, Delta Lake/Apache Iceberg...
Engineering, Python, SQL, Kafka, Data Orchestration, Apache Airflow, Confluent, API, Rest API, API Management, GCP, Tableau... fields Proficiency in Python, Java, or Scala for data processing and automation Hands-on experience with data orchestration...
with Databricks or Apache Spark (Python/Scala). Proficient in working with various database structures, including transactional... and Apache Spark. Provide expertise in Databricks workspace, cluster, and job management, focusing on performance tuning, cost...
with Databricks or Apache Spark (Python/Scala). Proficient in working with various database structures, including transactional... and Apache Spark. Provide expertise in Databricks workspace, cluster, and job management, focusing on performance tuning, cost...
areas. Preferred experience with programming languages like Scala, Java, or Python and tools like Apache Spark, Apache... technologies and methodologies, fostering continuous personal and professional growth. Good knowledge of Apache Spark and Scala...
that power intelligent enterprise experiences across millions of users worldwide. Job Responsibilities Lead the technical... experience on technologies like Apache Spark, Delta Lake, Snowflake, Kubernetes, etc. Hands-on experience with public cloud...
data pipelines using tools like Apache Kafka, Flink, or Spark Streaming to handle high-velocity data streams. Design..., and data quality standards. Lead architectural reviews and technical design sessions to guide solution development...
Data Engineering Expertise: Expert proficiency in Python and Scala/Java for building production data systems Deep hands...-on experience with Apache Spark (Spark SQL, DataFrames, Streaming) including performance tuning and optimization Strong expertise...
or product owner role will be desirable · Knowledge of data processing / ETL using Ab Initio / SAS / SSIS / Python / Scala... / Apache Spark / Databricks · Exposure to one or more Cloud platforms – Amazon Web Services (AWS), Microsoft Azure, Google...
Data Engineering Expertise: Expert proficiency in Python and Scala/Java for building production data systems Deep hands...-on experience with Apache Spark (Spark SQL, DataFrames, Streaming) including performance tuning and optimization Strong expertise...
: Expertise in Python, Scala, and SQL, with familiarity with rules-based and machine learning models and model governance; ideally... those relevant to transaction monitoring and sanctions screening Proficiency in Databricks and Apache Spark: Skilled in developing...
like Sagemaker, MLFlow, Kubeflow, or other platforms Big data - Hive, Spark, Hadoop, queuing system like Apache Kafka/Rabbit MQ/AWS... ML lifecycle. What You’ll Do Design and implement technical features leveraging best practices for technology stack...
programming, proficiency in Python/Scala for Spark development Advanced Data Technologies: Deep expertise in Apache Beam, Apache... & Mentorship Lead and mentor Data Engineers and other team members, fostering technical excellence and professional growth...
& Architecture Architect, implement, and oversee scalable data pipelines using Apache Spark, Databricks, and Azure Data Factory..., and Cassandra. Proficient in Python, SQL, and/or Scala, with experience in large‑scale distributed systems. Solid background...
. You'll lead through influence, shaping technical direction, mentoring engineers, and building the “single source of truth... Apache Airflow, Spark, Trino, and cloud-native tools. Develop high-performance data marts and semantic layers that serve...
, forecasting, and AI/ML. You'll lead through influence, shaping technical direction, mentoring engineers, and building the “single... and optimize ETL/ELT pipelines using Apache Airflow, Spark, Trino and cloud-native tools. Develop high-performance data marts...
and automation tools such as GitHub Enterprise, Jenkins, ArgoCD, or Cloud Build. Expert in Python, Scala, and Java with deep... in both batch and streaming modes. Design and deliver cloud-native data processing solutions using Spark, Beam, Flink, Dataflow...
areas. Preferred experience with programming languages like Scala, Java, or Python and tools like Apache Spark, Apache... knowledge of Apache Spark and Scala or Java is required for building scalable and efficient data pipelines. WHAT TAKEDA CAN...