. Experience in building and managing scalable data pipelines. Experience in big data processing frameworks (Spark, Flink... processing frameworks (Spark, Flink). Experience in CI/CD pipelines and DevOps practices. Don’t meet every single...
, tools, and platforms Hands-on experience with big data technologies (such as Hadoop, Spark, etc.) Ability to create...
Responsibilities include: Design and develop big data solutions using Spark, Scala, and related technologies... will have: Strong programming skills in Spark, Scala, Hive and Airflow. Hands-on experience with Big Data ecosystem. Expertise in Apache Spark...
, tools, and platforms Hands-on experience with big data technologies (such as Hadoop, Spark, etc.) Ability to create...
development is in Spark. Strong proficiency in Spark Core, Spark SQL. Expert-level programming skills in Scala, specifically... for developing Spark applications. Experience with Spark performance optimization techniques (e.g., caching, partitioning, shuffle...
). Familiarity with big data ecosystems (Spark, Hadoop). Experience with LLMs, generative AI, prompt engineering, or model fine...
data processes using Apache Spark for optimal performance and data processing efficiency. Proficiency in SQL: Utilize...
such as Apache Kafka, Hadoop, or Spark. - Experience working in an agile Mandatory skill sets: Java, Spring boot, Kotlin...
, Pyspark, with Spark components. 3-7 years of experience as Big Data Engineer to develop, optimize, and manage large-scale...
jobs for batch data with HiveQL and Spark (Scala/Java/Pyspark), Scheduling Jobs using oozie, Data loads/extraction using Sqoop.... Building Real-Time ingestion using Kafka and Spark Streaming, Data flow pipelines using Ni-Fi Building data pipelines...
). Experience working with Elasticsearch and indexing system. Hands-on experience with Spark and a working knowledge of DeltaLake.... Familiarity with Databricks for Spark management and job orchestration. Proficiency in Terraform and Terragrunt...
programming, Hadoop, Spark, Scala, Mongo DB, NoSQL SAP - SAP ABAP programming / SAP MM / SAP SD /SAP BI / SAP S4 HANA Oracle...
) Strong understanding and/or experience in some of the following, Batch or stream processing systems such as Apache Spark, Flink, Akka...
seamless integration of solutions. Performance & Troubleshooting: Debugging and optimizing Spark applications and big data... experience with Apache Spark (PySpark), Hadoop, and related components like Hive and Sqoop; skilled in writing shell scripts...
with Kubernetes Experience with Azure Databricks or equivalent Spark-based platform Familiarity with DevOps practices Exposure...
) needed ] Programming Languages Python, Java/Scala: Commonly used in big data frameworks like Apache Spark. C++: Useful for high... for ensuring code quality and model performance. Big Data Technologies Hadoop: For distributed data processing. Spark: For big...