Lead Data Engineer
نُشرت في :
15-08-2024
صاحب العمل نشط
1 وظيفة شاغرة
حالة تأهب وظيفة
سيتم تحديثك بأحدث تنبيهات الوظائف عبر البريد الإلكترونيValid email field required
أرسل الوظائف
شارك هذه الوظيفة
أرسل لي وظائف مشابهة
حالة تأهب وظيفة
سيتم تحديثك بأحدث تنبيهات الوظائف عبر البريد الإلكترونيValid email field required
أرسل الوظائف
الخبرة
5سنوات
الراتب الشهري
لم يكشف
لم يتم الكشف عن الراتب
عدد الوظائف الشاغرة
1 وظيفة شاغرة
نُشرت في :
15-08-2024
الوصف الوظيفي
Job Title: Lead Data Engineer
Location: WashingtonDc
Department: Congressional Budget Office (CBO)
Job Summary:
The Lead Data Engineer will play a crucial role in designing building and maintaining the data infrastructure of our organization. This position is responsible for overseeing the architecture and development of data pipelines that handle the collection transformation and storage of data within cloud environments. The Lead Data Engineer ensures that the data infrastructure meets the organizations requirements for performance scalability and accessibility.
Key Responsibilities:
Architecture Design:
- Design and implement scalable data architectures to meet the organizations data needs.
- Develop strategies for data ingestion transformation storage and retrieval in cloud environments.
- Ensure data architectures are aligned with organizational goals and industry best practices.
Data Pipeline Development:
- Lead the development and optimization of data pipelines for efficient data collection transformation and loading.
- Implement ETL (Extract Transform Load) processes to support various analytical and operational needs.
- Utilize cloudbased technologies such as AWS Azure or Google Cloud Platform for data processing and storage.
- Performance and Scalability:
- Monitor and optimize data pipeline performance to ensure high availability and reliability.
- Develop solutions that scale with increasing data volume and complexity.
- Implement best practices for data partitioning indexing and caching.
Data Integration:
- Integrate data from diverse sources including databases APIs and thirdparty services.
- Ensure data quality and consistency across integrated systems.
- Team Leadership:
- Lead and mentor a team of data engineers providing guidance on technical challenges and career development.
- Collaborate with crossfunctional teams including data scientists analysts and software engineers to support datadriven initiatives.
Compliance and Security:
- Implement data security and privacy measures to protect sensitive information.
- Ensure compliance with relevant data governance and regulatory requirements.
- Documentation and Reporting:
- Document data architecture pipelines and processes.
- Provide regular reports on data infrastructure performance and issues.
Qualifications:
- Bachelor s degree in Computer Science Engineering Information Systems or a related field. Master s degree preferred.
Experience:
- 7 years of experience in data engineering with a focus on designing and implementing data pipelines in cloud environments.
- Proven experience with cloud platforms (AWS Azure Google Cloud Platform) and associated data services.
- Strong background in ETL processes data warehousing and big data technologies (e.g. Hadoop Spark).
Skills:
- Proficiency in programming languages such as Python Java or Scala.
- Experience with SQL and NoSQL databases.
- Familiarity with data modeling data warehousing and data lake concepts.
- Excellent problemsolving skills and the ability to work with large datasets.
Soft Skills
- Strong leadership and team management abilities.
- Effective communication skills with the capability to explain complex technical concepts to nontechnical stakeholders.
- Demonstrated ability to work in a fastpaced collaborative environment.
"If you are: bright motivated skilled a differencemaker able to get things done work with minimum direction enthusiastic a thinker able to juggle and multitask communicate effectively and lead then we would like to hear from you. We need exceptionally capable people for this role for our client so get back to us and tell us why you think you are a fit."
About Us:
TriForce is one of the fastest growing companies in Philadelphia region by receiving the award 5 times and 3 times(Ranked #) on Inc. 5000 fastest growing companies in the USA. TriForce Consulting Services Inc. is an established consulting services firm offering innovative solutions to Government and Commercial sectors. We specialize in building customized software applications solutions such as knowledge management systems business intelligence data analysis database support and maintenance data warehouse implementation and support systems architecture and systems integration for our clients. Our technical competencies are in Java.NET SharePoint PHP Business Intelligence (Cog nos Data Warehouse) mobile applications platforms (iPhone iPad Android Blackberry) and various other technologies. We also specialize in providing resources to manage infrastructure projects. TriForce is one of the fastest growing companies in the Philadelphia region by receiving the award 5 times and 2 times on Inc. 5000 fastest growing companies in the USA.
Skills: Proficiency in programming languages such as Python, Java, or Scala. Experience with SQL and NoSQL databases. Familiarity with data modeling, data warehousing, and data lake concepts. Excellent problem-solving skills and the ability to work with large datasets.
نوع التوظيف
دوام كامل
المهارات المطلوبة
الإبلاغ عن هذه الوظيفة
إخلاء المسؤولية: د.جوب هو مجرد منصة تربط بين الباحثين عن عمل وأصحاب العمل. ننصح المتقدمين بإجراء بحث مستقل خاص بهم في أوراق اعتماد صاحب العمل المحتمل.
نحن نحرص على ألا يتم طلب أي مدفوعات مالية من قبل عملائنا، وبالتالي فإننا ننصح بعدم مشاركة أي معلومات شخصية أو متعلقة بالحسابات المصرفية مع أي طرف ثالث. إذا كنت تشك في وقوع أي احتيال أو سوء تصرف، فيرجى التواصل معنا من خلال تعبئة النموذج الموجود على الصفحة اتصل بنا
