Senior Principal AI Data Engineer
USA VA Crystal City - 2521 S Clark St (VAC119), United States
USD 174K-235K Senior-level Full Time
Tasks
- Build model ready datasets
- Cache retrieved data
- Define downstream schemas and interfaces
- Deploy reproducible pipelines
- Design data pipelines
- Develop ETL processes
- Develop microservices
- Enable low latency retrieval
- Implement data lakehouse storage
- Implement event-driven architecture
- Implement vector stores
- Ingest multi source data
- Manage version control with git
- Operate in Linux environments
- Optimize data access patterns
- Optimize indexing strategies
- Perform peer code reviews
- Perform performance tuning
- Tune search and retrieval
- Use CI/CD workflows
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | CI/CD | Data Lakehouse | Database optimization | ETL | Elasticsearch | Embeddings | Event Driven | Event-driven architecture | Extract Transform | Extract Transform Load | Git | Linux | Microservices | OpenSearch | Python | SQL | Vector Database | Vector Search | Vector indexing
Education
Roles
Related jobs
-
Senior Machine Learning Engineer USD 150K-225KAIOps | AWS | Azure | Data Analysis | Data Visualization401k match | Career growth opportunities | Dental insurance | Employee resource groups | Flexible paid time offSenior-level Full TimeRemote, United States2h ago
-
Senior Data Engineer USD 120K-175K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States2h ago
-
Lead AI Engineer-Machine Learning USD 110K-198KAWS | Agile | Azure | CI/CD | Cloud platform401k match | Dental insurance | Disability insurance | Growth opportunities | Holiday paySenior-level Full TimeParsippany, NJ, United States2h ago
-
Lead AI Engineer USD 180K-280KAWS SageMaker | Azure Machine Learning | CI/CD | ColBERT | DockerChildcare benefits | Onsite gym | Tuition assistanceSenior-level Full TimeQuincy, MA, United States3h ago
-
Senior Cloud Data Ops Engineer USD 140K-180KAWS | Amazon Aurora | Amazon RDS | Bash | BigQuery401k match | Bonus eligibility | Childcare benefits | Gym access | Insurance coverageSenior-level Full TimeQuincy, MA, United States3h ago
-
Embedded Software Engineer - Energy Systems USD 73K-94KARM | Bare Metal | Battery Management | Battery Management Systems | C#401k matching | Dental insurance | Employee assistance program | Life insurance | Medical insuranceMid-level Full TimeGreene, NY, United States3h ago
-
AI Enterprise Architect USD 118K-220KAI Foundry | API | Artificial Intelligence | Azure AI | Azure AI FoundryEqual opportunity employer | Travel 15 to 25 percent timeSenior-level Full TimeKansas City, KS, United States3h ago
-
Senior-level ContractBeaverton, OR, US4h ago
-
Data Engineer USD 90K-130KBusiness Objects | Change Management | Data Governance | Data Lineage | Data ModelingMid-level Full TimeNashville, TN, United States4h ago
-
API | Agile Software Development | Agile software | Apache Kafka | Application developmentSenior-level Full TimeDearborn, United States5h ago
-
Data Engineer CAD 100K-170KAWS | Apache Airflow | Azure | BigQuery | Cloud Computing401k | Asynchronous work culture | Autonomy | Company paid life insurance | Disability coverageMid-level Full TimeRemote - US or Canada R5h ago
-
Senior Data Engineer ID71671 USD 155K-170KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | Batch ProcessingAnnual learning budget | Flexible hours | Learning budget | Mentorship | Mentorship supportSenior-level Full TimeNew York, United States5h ago
-
Senior Data Engineer ID71671 USD 155K-170KAWS Kinesis | Apache Airflow | Automated testing | CI/CD | DBTCollaborative culture | Flexible hours | Internal tech talks | Learning budget | MentorshipSenior-level Full TimeRichmond, United States5h ago
-
Senior Data Engineer ID71671 USD 155K-170KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDAnnual learning budget | Flexible hours | Internal tech talks | Local well being programs | MentorshipSenior-level Full TimeMiami, United States5h ago
-
Senior Data Engineer ID71671 USD 155K-170KApache Airflow | Automated testing | CI/CD | Dagster | Data LineageAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | People focused supportSenior-level Full TimeOrlando, United States5h ago
-
Senior Data Engineer ID71671 USD 155K-170KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | CI/CDAnnual learning budget | Flexible hours | Mentorship | Performance reviews | Remote workSenior-level Full TimeJacksonville, United States5h ago
-
Senior Data Engineer ID71671 USD 155K-170KAWS | AWS Kinesis | Apache Airflow | Apache Kafka | AzureAnnual learning budget | Flexible hours | Health and wellbeing programs | Learning budget | MentorshipSenior-level Full TimeWest Palm Beach, United States5h ago
-
Senior Data Engineer ID71671 USD 155K-170KApache Airflow | CI/CD | DBT | Dagster | Data LineageFlexible hours | Internal tech talks | Learning budget | Local support programs | MentorshipSenior-level Full TimeDallas, United States5h ago
-
Senior Data Engineer ID71671 USD 155K-170KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | Batch ProcessingAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | People focused supportSenior-level Full TimeAtlanta, United States5h ago
-
Senior Data Engineer ID71671 USD 155K-170KAWS Kinesis | Amazon Web Services | Apache Airflow | Apache Kafka | Automated testingAnnual learning budget | Flexible hours | Mentorship | Remote work | TechtalksSenior-level Full TimeSan Francisco, United States5h ago
-
Senior Data Engineer ID71671 USD 155K-170KAWS Kinesis | Apache Airflow | Apache Kafka | Automated testing | Batch ProcessingFlexible hours | Internal tech talks | Learning budget | Mentorship | People focused supportSenior-level Full TimeChicago, United States5h ago
-
Senior Data Engineer ID71671 USD 155K-170KAmazon Kinesis | Apache Airflow | Apache Kafka | CI/CD | DBTFlexible hours | Learning budget | Mentorship | Remote work | Well-being programsSenior-level Full TimeTallahassee, United States5h ago
-
Senior Data Engineer ID71671 USD 155K-170KAWS Kinesis | Apache Airflow | Automated testing | CI/CD | DBTFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeBoston, United States5h ago
-
Senior Data Engineer ID71671 USD 155K-170KAWS Kinesis | Apache Airflow | Apache Kafka | CI/CD | DBTAnnual learning budget | Flexible hours | Mentorship | Performance and compensation reviews | Remote workSenior-level Full TimeIrving, United States5h ago
-
Senior Data Engineer ID71671 USD 155K-170KApache Airflow | Automated testing | Batch Processing | CI/CD | DBTAnnual learning budget | Flexible hours | Mentorship | Performance reviews | Remote workSenior-level Full TimeTexas City, United States5h ago