Datgroup LLC
About Datgroup
Datgroup LLC is a growing technology consulting company focused on helping federal customers modernize how they integrate, manage, govern, and use data.
We work on complex, mission-focused technology initiatives where reliable data, modern cloud platforms, and thoughtful engineering directly support government operations. Our teams work across data engineering, systems integration, cloud technologies, and modern data platforms to turn complex requirements into secure, scalable solutions.
As a growing company, we value engineers who want to do more than execute tickets. We are looking for people who enjoy solving difficult problems, collaborating directly with technical and business stakeholders, and helping shape how solutions are designed and delivered.
The Opportunity
Datgroup is seeking an experienced Senior Data Engineer with strong hands-on Databricks experience to help design, build, and support modern data pipelines and data platform solutions within a federal environment.
You will work with architects, engineers, product teams, analysts, and customer stakeholders to ingest data from multiple source systems, transform and standardize it for downstream use, and build reliable data products within the Databricks ecosystem.
This is a hands-on engineering role for someone comfortable working across the full data lifecycle, from source-system integration and ingestion through transformation, data quality, governance, performance optimization, and production support.
What You'll Work On
Design, build, and maintain scalable data pipelines using Databricks.
Develop ETL/ELT processes for ingesting, transforming, validating, and delivering data from multiple source systems.
Work with Apache Spark, PySpark, SQL, Delta Lake, Databricks notebooks, Jobs, and Workflows.
Build and optimize batch and streaming data processing solutions.
Support modern lakehouse architectures and Databricks platform implementations.
Develop reusable engineering patterns for data ingestion and transformation.
Implement data quality rules, reconciliation processes, validation controls, and monitoring.
Support data governance, access controls, metadata management, and lineage through Unity Catalog.
Troubleshoot pipeline failures, performance bottlenecks, data integrity issues, and production defects.
Optimize Spark workloads, SQL queries, and data transformations for reliability and performance.
Work with APIs, databases, files, cloud storage, and other enterprise data sources.
Collaborate with architects and engineering teams on platform standards and technical design decisions.
Translate business and technical requirements into scalable data engineering solutions.
Participate in customer discussions, technical workshops, design sessions, demonstrations, and implementation reviews.
Develop and maintain technical documentation, including data flows, mappings, pipeline designs, interface specifications, and operational procedures.
Support emerging Databricks capabilities and AI-enabled data solutions where appropriate.
Required Qualifications
U.S. Citizenship and ability to obtain and maintain a Public Trust.
Bachelor's degree plus 12 years of relevant experience, OR Master's degree plus 9 years of relevant experience.
Significant professional experience in data engineering or a closely related engineering role.
Strong hands-on experience with Databricks and the Databricks ecosystem.
Strong experience designing and developing ETL/ELT data pipelines.
Strong proficiency with Python/PySpark and SQL.
Experience with Apache Spark and Delta Lake.
Experience working with structured, semi-structured, and unstructured data.
Experience implementing data quality, validation, monitoring, and reconciliation processes.
Experience with Unity Catalog, including permissions, governance, metadata, lineage, and access-control concepts.
Experience working with cloud-based data platforms, preferably AWS.
Experience troubleshooting complex data pipeline, performance, and data-integrity issues.
Understanding of modern data architecture and data engineering design patterns.
Strong written and verbal communication skills.
Ability to work effectively with technical teams, business stakeholders, and government customers.
Preferred Qualifications
Current or previous DHS / ICE Public Trust.
Experience supporting data platforms or integrations within DHS or another federal agency.
Experience with AWS data and integration services.
Experience designing or implementing Lakehouse or Medallion architectures.
Experience with REST APIs and API-based data integrations.
Experience with API management or security platforms such as MuleSoft or Kong.
Experience with CI/CD pipelines, infrastructure automation, and Git-based development workflows.
Experience with Databricks Workflows or other orchestration technologies.
Experience with streaming technologies such as Spark Structured Streaming or Kafka.
Experience with data modeling and development of common or standardized data models.
Exposure to Unity Catalog AI Gateway, Agent Bricks, or other Databricks AI capabilities.
Experience implementing enterprise data governance, security, privacy, and compliance controls.
Databricks certifications.
Federal consulting or customer-facing technical delivery experience.
Why Datgroup?
At Datgroup, you'll have the opportunity to work on challenging data problems while helping build a growing technology company.
We offer a collaborative environment where experienced engineers are trusted to contribute ideas, influence technical decisions, and take ownership of meaningful work. You'll work with modern technologies while supporting mission-critical federal programs where reliable data and well-designed systems matter.
We are looking for engineers who are technically strong, curious, dependable, and comfortable taking a problem from requirement through implementation.
Interested? Apply through LinkedIn or contact Datgroup to learn more about the opportunity.
Equal Employment Opportunity
Datgroup LLC is an equal opportunity employer. Employment decisions are based on qualifications, merit, and business needs. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, or any other status protected by applicable federal, state, or local law.
Pay: $133,685.47 - $160,997.55 per year
Benefits:
Work Location: Remote
