Job Description

KPI Partners is seeking a skilled Databricks Engineer with expertise in Spark to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and maintaining data solutions in a Databricks environment. You will work closely with data scientists, data engineers, and business stakeholders to understand their data needs and deliver high-quality solutions.

Key Responsibilities:
- Develop and maintain data pipelines using Apache Spark in Databricks.
- Collaborate with teams to design scalable and efficient data architectures.
- Ensure data quality and integrity through data validation and testing processes.
- Optimize Spark jobs and performance tuning for efficient data processing.
- Monitor and troubleshoot data applications to ensure smooth operations.
- Participate in code reviews and contribute to best practices in data engineering.
- Assist in the development of data models and data integration strategies.
- Stay updated with the latest Databricks features and Spark advancements.

Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- Proven experience with Databricks and Apache Spark.
- Strong programming skills in Python, Scala, or Java.
- Familiarity with big data technologies such as Hadoop and data warehousing solutions.
- Experience with ETL tools and processes.
- Knowledge of data visualization tools is a plus.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.

Benefits:
- Competitive salary and performance-based bonuses.
- Opportunities for professional development and training.
- Flexible work hours and a supportive work environment.
- Health and wellness benefits.
- Collaborative and innovative company culture.

If you are passionate about data engineering and ready to take on new challenges, we invite you to apply for this exciting opportunity at KPI Partners. Join us in transforming data into actionable insights!

More Info

Education