Principal Data Engineer
Tasks
- Conduct peer reviews of pipeline configurations and schemas
- Deliver Agile Scrum sprint milestones and compliance requirements
- Design secure data movement between Apache NiFi and external systems
- Develop and maintain documentation for pipelines and integration tests
- Implement and validate data transfer reliability
- Support secure data transport architecture with enterprise standards
- Troubleshoot data flow failures across system boundaries
- Validate data formats and schema alignment
Perks/Benefits
Skills/Tech-stack
Access Control | Agile | Apache NiFi | Avro | CI/CD | Data Modeling | DevSecOps | Encryption in Transit | Groovy | Integration Engineering | JSON | Java | Kubernetes | Protobuf | Python | REST API | Schema Validation | Scrum | XML
Education
N/A
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R9d ago
-
Research Engineer, FAIR AI & Society USD 117K-173KAI alignment | Apache Hive | Apache Spark | Artificial Intelligence | DPOEntry-level Full TimeMenlo Park, CA | New York, …1h ago
-
Software Engineer, Systems USD 221K-240KAlgorithms | CSS | Data Analysis | Data Modeling | Data ProcessingEntry-level Full TimeBellevue, WA1h ago
-
ASIC | C plus plus | C# | Clock Domain Crossing | Coverage analysisSenior-level Full TimeMountain View, CA, USA1h ago
-
AI infrastructure | Accelerator Virtualization | Container Runtime | Distributed Systems | GPUSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA1h ago
-
Senior Software Engineer, AI/ML, Google Cloud AI USD 174K-252KC++ | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA1h ago
-
Algorithms | C++ | Data Structures | Data Visualization | DebuggingSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Senior Software Engineer, AI and Infrastructure USD 174K-252KArtificial Intelligence | C++ | Code review | Data Storage | Data StructuresSenior-level Full TimeSunnyvale, CA, USA1h ago
-
2026 Summer Internship | Data Analytics & AI USD 50K-90KDashboarding | Data Engineering | Data Pipelines | Data analytics | ETLCareer development opportunities | Community service opportunities | Executive spotlights | Hybrid schedule | Professional development sessionsEntry-level InternshipMiramar, FL, US, 331326h ago
-
Senior Machine Learning Engineer USD 150K-200KDistributed Systems | Feature Engineering | Feature Selection | Language Models | Language Processing401k matching | Cell phone and internet stipend | Employee stock purchase plan | Flexible time off | Learning programsSenior-level Full TimeRemote - USA R8h ago
-
Senior AI Automation Engineer, CS Ops - Moveworks USD 187K-295KAI tools | API | Agent Frameworks | Analytics | AutomationRemote work flexibilitySenior-level Full TimeMountain View, CALIFORNIA, United States9h ago
-
Software Engineer - Robot Link Platform USD 160K-232KAPI Design | Apache | Caching | Cloud services | DatabasesMid-level Full TimeFoster City, CA9h ago
-
Senior Robotics Software Engineer - Simulation USD 130K-170KBullet | C++ | CI/CD | Data Generation | Digital TwinsSenior-level Full TimeSan Jose, CA9h ago
-
Senior-level Full TimeSan Jose, CA10h ago
-
Senior Software Engineer - Data Platform USD 186K-218KAccess Control | Airflow | Apache Kafka | Apache Spark | CachingSenior-level Full TimeRemote - USA R10h ago
-
Computational Geometry Software Engineer USD 130K-250KC++ | CAD | CAM | Docker | GPU Computing401k | Dental insurance | Flexible vacation policy | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, CA10h ago
-
Software Engineer - Reference Data (Java/SQL) USD 175K-200KAPI Development | Distributed Systems | Git | HBase | HadoopMid-level Full TimeNew York10h ago
-
Senior-level Full TimeHybrid (Salt Lake City, UT, US) R11h ago
-
Machine Learning Engineer, Geometry Team USD 175K-215K3D Spatial Reasoning | C++ | Computer Vision | Distributed Training | JAXSenior-level Full TimeKirkland, Washington, United States12h ago
-
Lead- Full Stack Engineer USD 150K-190KAWS Fargate | AWS Lambda | Amazon RDS | Amazon S3 | CI/CDCareer development opportunities | Entrepreneurial environment | Equal employment opportunity | High responsibilityMid-level Full TimeMcLean, Virginia, United States13h ago
-
AI Search | AWS | Amazon SageMaker | Azure AI | Azure AI Search401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States13h ago
-
AWS S3 | Ansible | Automation | Azure Blob | Azure Blob Storage401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States13h ago
-
Senior-level Full TimeRedmond, WA, US14h ago
-
Sr. Staff AI Engineer, GenAI Safety USD 191K-315KAI Safety | Content Safety | Distillation | Distributed Systems | Evaluation PipelineHealth and wellness programs | Time offSenior-level Full TimeMountain View, CA, United States14h ago
-
Software Engineer - Perception (Fallback Stack) USD 151K-255KC++ | Computational Geometry | Confidence Calibration | Deep learning | Linear Optimization401k matching | Comprehensive health insurance | Learning and wellness stipends | Paid time offMid-level Full TimeSunnyvale, California, United States14h ago