Job Description

KPI Partners is seeking a skilled Databricks Specialist to join our team. The ideal candidate will possess a strong background in data engineering, analytics, and machine learning with substantial experience in the Databricks platform.

Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL processes on Databricks.
- Collaborate with data scientists and analysts to support analytics initiatives using Databricks and Apache Spark.
- Optimize data engineering workflows for performance and cost efficiency.
- Monitor and troubleshoot data processing jobs and workflows to ensure high availability and reliability.
- Implement and maintain data governance and security measures on Databricks.
- Provide technical guidance and support to team members on Databricks best practices and performance tuning.
- Stay updated with the latest trends in data engineering, big data, and cloud technologies.

Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Proven experience in working with Databricks, Apache Spark, and big data technologies.
- Strong programming skills in languages such as Python, Scala, or SQL.
- Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
- Experience with data visualization tools and frameworks.
- Excellent problem-solving skills and the ability to work independently as well as part of a team.

Preferred Qualifications:
- Databricks certification or relevant big data certifications.
- Experience with machine learning libraries and frameworks.
- Knowledge of data warehousing solutions and methodologies.

If you are passionate about data and possess a deep understanding of Databricks and its capabilities, we encourage you to apply for this exciting opportunity with KPI Partners. Join us in our mission to leverage data for impactful decision-making.

More Info

Education