LEAD Consultant - Databricks Engineer Job at YuVi Systems Inc, Dallas, TX

eFROS3VZRFRvd0VpcjJjZTNxMGU1c2lvZFE9PQ==
  • YuVi Systems Inc
  • Dallas, TX

Job Description

Location: Remote |  Domain: Healthcare (Payers)

Company: Yuvi Systems

Overview:

Yuvi Systems is seeking a  Senior Databricks Engineer with deep expertise in Databricks tools and frameworks, particularly within the  Healthcare Payer domain . This role involves designing and implementing scalable, high-performance data pipelines to support analytics, reporting, and regulatory compliance.

Key Responsibilities:
  • Design and build scalable data pipelines using  Databricks (notebooks, workflows, clusters) .
  • Process and transform healthcare data in  HL7, CCDA, FHIR , XML, JSON, and delimited formats.
  • Implement  Delta Lake for ACID-compliant data operations and performance optimization.
  • Manage secure cloud storage (Azure Blob, S3, or Databricks Volumes) for data ingestion and access.
  • Develop ETL/ELT pipelines using  Delta Live Tables (DLT)and automate workflows.
  • Code in  PySpark, Scala, SQL , and optimize transformations in distributed environments.
  • Integrate Databricks with Power BI and develop reports/dashboards.
  • Leverage  Unity Catalog for data lineage, access control, and governance.
  • Embed  DevOps and CI/CD practices (GitLab, DABs) into data workflows.
  • Mentor junior engineers and support cross-functional collaboration.
  • Deliver high-quality, timely solutions aligned with client needs and data quality standards.
Required Experience & Skills:
  • 5+ years in Data Engineering; 3+ years with  Databricks .
  • Experience in the  Healthcare Payer domain (claims, eligibility, HIPAA/CMS compliance).
  • Strong with  Delta Lake PySpark , and  Apache Spark .
  • Hands-on with  ETL/ELT in Azure or AWS .
  • Proficient in  Power BI (DAX, dataset tuning, report development).
  • Solid understanding of  Medallion Architecture and  Lakehouse principles.
  • Experience with structured/semi-structured data, APIs, and cloud storage.
  • Skilled in Git, CI/CD, and DevOps practices.
  • Excellent communication and consulting skills.
  • Bachelor's in Computer Science, Information Systems, or related field.

Job Tags

Remote job,

Similar Jobs

Insight Global

Escrow Officer Job at Insight Global

 ...Understanding the escrow process to determine what steps need to be taken to conduct a closing pursuant to the conditions called for in the real estate contract and lender instructions. *Collaborates with the title department to resolve title issues such as legal descriptions,... 

Magellan Financial & Insurance Services, Inc.

Part-Time Administrative Assistant Job at Magellan Financial & Insurance Services, Inc.

 ...Part-Time Administrative Assistant Join a Boutique Financial Practice in Walnut Creek, CA! Attain Wealth Protection, Inc. | $30/hour | | In-Office | 4 hrs/day Are you highly organized, detail-driven, and experienced in annuities and insurance? Looking for a flexible... 

KARDION

Regulatory Affairs Specialist Job at KARDION

 ...Title : Regulatory Affairs Specialist Reports to : VP of Quality & Regulatory Affairs Location: Remote initially then transitions to on-site (Irvine, CA office) Salary Range: $110,000 - $120,000 per year Local candidates only; no relocation will be provided... 

Stake Recruiting

Game Tester Job at Stake Recruiting

Description: Want to be a Game Tester? As a game tester, you will play a crucial role in ensuring the continuous operation of online games released to the public. Duties: Test different developed games for functionality Report issues found during testing to ...

Medical Services of America

Chaplain Hospice Job at Medical Services of America

 ...home (requires minimal after-hours work) Attends biweekly IDT meetings Job Requirements At least one unit of clinical pastoral education (CPE) required. Graduate of an accredited seminary or school of theology, or appropriate certification in hospital...