IT Data Engineer
Tasks
- Architect data lake warehouse lakehouse solutions
- Build RAG pipelines
- Build generative AI and agent data pipelines
- Communicate technical decisions and trade-offs
- Create reusable data pipeline frameworks
- Define data contracts for data to AI integration
- Define data governance policies classification access control lineage retention
- Define data partitioning optimization and caching strategies
- Define data platform architecture
- Define problem statements success metrics and technical approach
- Design AI data architectures for model training
- Design scalable data platforms
- Detect and resolve data quality reliability performance and cost gaps
- Drive engineering best practices and CI/CD adoption
- Ensure regulatory compliance
- Establish monitoring alerting and SLA frameworks
- Govern embedding pipelines and AI datasets
- Implement cloud cost optimization
- Implement embedding pipelines
- Implement unstructured data processing pipelines
- Integrate vector databases graph databases and semantic search
- Integrate vector store ingestion
- Lead technical design reviews and ADRs
- Maintain engineering playbooks and documentation
- Manage knowledge base refresh
- Mentor and coach data engineers
- Partner with stakeholders to translate needs into data solutions
- Perform incident response root cause analysis
- Support cross functional planning with AI analytics and business teams
Perks/Benefits
- N/A
Skills/Tech-stack
AI Search | Apache Spark | Azure | Azure AI | Azure AI Search | Azure Monitor | CI/CD | Caching | Cause analysis | Data Governance | Data Lineage | Data Modeling | Data Partitioning | Data Processing | Data Quality | Data Security | Data Vault | Databricks | Databricks Workflows | Delta Lake | Dimensional Modeling | Docker | Document parsing | Embeddings | Feature Store | Graph Databases | Incident Response | Kubernetes | Lakehouse Medallion | Log Analytics | Logging | Monitoring | Pinecone | Python | RAG | Root Cause Analysis | Root cause | SQL | Scala | Semantic Search | Unity Catalog | Unstructured Data | Unstructured Data Processing | Vector Databases | Vector Search | Weaviate
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R13d ago
-
Intelligent Systems Engineer II USD 92K-151KAPIs | AWS | Artificial Intelligence | Automation | Backend Development401k match | Community service day | Flexible spending accounts | Life insurance | Medical/Dental/VisionMid-level Full TimeWest Chester, OH, United States6h ago
-
Azure DevOps | Data Modeling | Data integration | ETL | GitHubSenior-level ContractSaint Paul, United States7h ago
-
Senior Machine Learning Engineer USD 150K-200KAPI Development | AWS SageMaker | Data Pipelines | FastAPI | Feature EngineeringSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL7h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KBenchmarking | Cloud Computing | Computer Vision | Data Annotation | Data QualityEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote and office optionsEntry-level Full TimeAddison, United States8h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KCloud Computing | Computer Vision | Image Processing | Machine Learning | Model EvaluationFlexible schedule | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsEntry-level Full TimeRichardson, United States8h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KAnnotation Workflows | Cloud Computing | Computer Vision | Data Quality | Image ProcessingFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote optionsEntry-level Full TimeGarland, United States8h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KAnnotation tools | Cloud Computing | Computer Vision | Data Quality | Image ProcessingEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsEntry-level Full TimeFort Worth, United States8h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KBenchmarking | Cloud Computing | Computer Vision | Data labeling | Experiment trackingEducation budget | Fitness budget | Flexible schedule | Growth roadmaps | MentorshipEntry-level Full TimePlano, United States8h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KCloud Computing | Computer Vision | Image Processing | Machine Learning | Object DetectionFlexible schedule | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsEntry-level Full TimeArlington, United States8h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KCloud Computing | Computer Vision | Data labeling | Image Processing | Machine LearningFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksEntry-level Full TimeCarrollton, United States8h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Clustering | Computer Vision | Data Quality | Edge ComputingFlextime | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeMcKinney, United States8h ago
-
MLOps Engineer ID72409 USD 100K-168KCI/CD | Cloud Computing | Concept drift | Concept drift detection | Data DriftEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsMid-level Full TimeGarland, United States8h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Cameras | Clustering | Computer Vision | Computer vision hardwareFlexible schedule | Flextime | Mentorship | Personalized growth roadmaps | Professional growthSenior-level Full TimeAllen, United States8h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Cameras | Clustering | Computer Vision | Data AnalysisFlextime | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeAddison, United States8h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Cameras | Clustering | Computer Vision | Edge DevicesEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote and office optionsSenior-level Full TimeFort Worth, United States8h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Clustering | Computer Vision | Computer vision hardware | Data ScienceFlextime | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeCarrollton, United States8h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Clustering | Computer Vision | Deployment | Edge ComputingFlexible schedule | Mentorship | Personalized growth roadmaps | Remote and office options | TechtalksSenior-level Full TimeFrisco, United States8h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Edge ComputingFlexible schedule | Flextime | Personalized growth roadmaps | Professional growth | Remote work optionsSenior-level Full TimeArlington, United States8h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Clustering | Computer Vision | Data Analysis | Edge ComputingFlextime | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeLewisville, United States8h ago
-
Junior/Middle Computer Vision Engineer ID72410 USD 98K-159KBenchmarks | Cloud Computing | Computer Vision | Data Quality | Data labelingEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsEntry-level Full TimeDallas, United States8h ago
-
MLOps Engineer ID72409 USD 100K-168KCI/CD | Cloud Computing | Docker | Drift Detection | Experiment trackingEducation budget | Fitness budget | Flexible schedule | Mentorship | Professional growthMid-level Full TimeCarrollton, United States8h ago
-
Senior Computer Vision Engineer ID72408 USD 160K-240KAnomaly Detection | Clustering | Computer Vision | Data Science | Edge ComputingEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimePlano, United States8h ago
-
MLOps Engineer ID72409 USD 100K-168KCI/CD | Cloud Computing | Concept drift | Concept drift detection | ContainerizationFlexible schedule | Mentorship | Office option | Personalized growth roadmaps | Professional growthMid-level Full TimeAddison, United States8h ago
-
MLOps Engineer ID72409 USD 100K-168KCI/CD | Cloud Computing | Containerization | Docker | Drift DetectionEducation budget | Exciting projects | Fitness budget | Flextime | MentorshipMid-level Full TimeAllen, United States8h ago