Principal Data Engineer
Tasks
- Architect enterprise data platforms
- Build real time streaming integrations
- Design data models and normalization
- Develop ETL and ELT workflows
- Develop data pipelines
- Ensure data governance and security compliance
- Establish best practices for coding and CI CD
- Implement Infrastructure-as-Code frameworks
- Implement data quality metadata lineage and auditing
- Improve monitoring observability and operations
- Lead data integration from core and third party systems
- Lead orchestration and delivery pipelines
- Mentor engineers and conduct design reviews
- Optimize data lake and warehouse solutions
- Optimize query performance and workload tuning
- Provide technical leadership and architectural guidance
- Translate business requirements into data solutions
Perks/Benefits
Skills/Tech-stack
AWS Glue | Airflow | Amazon S3 | Apache Spark | Azure | Azure Data | CI/CD | DBT | Data Auditing | Data Governance | Data Lineage | Data Quality | Data Vault | Data Vault 2 | Data Vault 2 0 | ELT | ETL | Event Driven | Event-driven architecture | GDPR | Git | HIPAA | HIPAA compliance | Informatica | Informatica IDMC | Informatica IICS | Infrastructure as Code | Kafka | Metadata Management | Monitoring | NAIC | Observability | Python | SOX | SQL | Snowflake | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Principal | Principal Data Engineer
Regions
Countries
States
Cities
Related jobs
-
Data Engineer II USD 145K-165KAWS | Agile | Apache Airflow | Apache Spark | CI/CD401k match | Company-provided phone | Extended leave | Generous PTO | Health insuranceMid-level Full TimeNew York, New York, United States16h ago
-
API | AWS Glue | Amazon Redshift | Amazon Web Services | Apache AirflowFully remote | Mentorship opportunities | On-call supportSenior-level Full TimeOrlando, FL, United States R18h ago
-
Senior Data Engineer USD 140K-160KAirflow | Apache Spark | Auto Loader | CI/CD | Change Data Capture401k | Paid leave | Tuition reimbursementSenior-level Full TimeNorth Hollywood, CA, United States18h ago
-
Senior Data Engineer – Hardware & Supply Chain USD 147K-203KAWS | Apache Iceberg | DBT | Data Governance | Data ModelingFlexible wellness time off | Paid Holidays | Paid sick leave | Paid time off | Parental leaveSenior-level Full TimeHybrid - San Francisco, California R19h ago
-
Mid-level Full TimeMiami Lakes, FL, United States20h ago
-
Robotics Software Intern – Real-Time Controls USD 80K-116KActuators | C++ | Control Systems | Coordinate systems | EncodersEntry-level InternshipAustin, TX20h ago
-
Hive | Microstrategy | MySQL | Oracle | Python401k | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States20h ago
-
Senior AI Engineer USD 193K-240KAPI | Access Control | Audit Logging | CI/CD | Cloud Native401k employer match | Dental insurance | Dependent care FSA | Employer paid commuter benefit | Flexible time offSenior-level Full TimeDallas, Texas, United States21h ago
-
Agile | Calculus | Classification | Linear Algebra | Machine LearningSenior-level Full TimeMc Lean, VA, United States23h ago
-
Agile | Amazon Web Services | As-a-Service | Calculus | ClassificationMid-level Full TimeTysons, VA, United States23h ago
-
Algorithms | Data Structures | Java | JavaScript | LLM toolsSenior-level Full TimeMc Lean, VA, United States23h ago
-
AWS | Autogen | Automated testing | Azure | CI/CDOnsite workSenior-level ContractDallas, United States1d ago
-
Databricks Engineer USD 97K-162KAPI Integration | Agile | Data Governance | Data Modeling | Data QualityMid-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …1d ago
-
Data Scientist, Innovation Hub USD 108K-108KAudit Logging | Azure | CI/CD | Federated identity | Integration TestingCareer growth | Healthcare | On-site childcare | PTO | Paid HolidaysMid-level Full TimeTexas-Dallas-5323 Harry Hines Blvd1d ago
-
Databricks Engineer USD 107K-179KAPI Integration | Agile | Cloud Computing | Data Governance | Data ModelingTravel 10 to 15 percentMid-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …1d ago
-
Senior Data Engineer USD 133K-158KAKS | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimeCincinnati, Ohio, United States1d ago
-
AI Program Lead USD 159K-265KAI Governance | Agent-Based Artificial Intelligence | Agent-based | Artificial Intelligence | Business IntelligenceMentorship | Professional development | Travel up to 25 percentSenior-level Full TimeArlington/Rosslyn, Virginia, United States1d ago
-
Associate BI Analytics Engineer USD 98K-163KDAX | Data Modeling | Data Warehousing | Databricks | ELTMid-level Full TimeUSA-VA-Herndon1d ago
-
Senior Software Engineer - Data & Analytics Federation USD 160K-240KApache Arrow | Asynchronous frameworks | C++ | Distributed Systems | Linux401k match | Dental insurance | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimePrinceton1d ago
-
Data Engineer, Employee Technology Support USD 110K-130KCause analysis | Data Governance | Data Modeling | Data Monitoring | Data Quality401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeNew York1d ago
-
AI orchestration | Alerting | Caching | Distributed Systems | DockerDental insurance | Medical insurance | Paid time off | Savings plan options | Vision insuranceSenior-level Full TimeSan Francisco, CA, United States R1d ago
-
A/B | A/B Testing | APIs | Anthropic | B testingDental insurance | Medical insurance | PTO | Remote | Savings plan optionsMid-level Full TimeSan Francisco, CA, United States R1d ago
-
Alerting | Batching | Caching | Distributed Systems | DockerDental insurance | Medical insurance | Paid time off | Remote work | Savings planMid-level Full TimeSan Francisco, CA, United States R1d ago
-
Security Engineer III - AI/ML USD 170K-215KAPI Development | AWS | Anomaly Detection | Azure | BERTSenior-level Full TimePlano, TX, United States1d ago
-
Agent Orchestration | Bias Mitigation | Data Structures | Data Structures and Algorithms | Graph theorySenior-level Full TimeSunnyvale, CA | Bellevue, WA | …1d ago