Lead Data Engineer
Posted on :
15-08-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Jobs by Experience
5years
Monthly Salary
Not Disclosed
Salary Not Disclosed
Vacancy
1 Vacancy
Posted on :
15-08-2024
Job Description
Job Title: Lead Data Engineer
Location: WashingtonDc
Department: Congressional Budget Office (CBO)
Job Summary:
The Lead Data Engineer will play a crucial role in designing building and maintaining the data infrastructure of our organization. This position is responsible for overseeing the architecture and development of data pipelines that handle the collection transformation and storage of data within cloud environments. The Lead Data Engineer ensures that the data infrastructure meets the organizations requirements for performance scalability and accessibility.
Key Responsibilities:
Architecture Design:
- Design and implement scalable data architectures to meet the organizations data needs.
- Develop strategies for data ingestion transformation storage and retrieval in cloud environments.
- Ensure data architectures are aligned with organizational goals and industry best practices.
Data Pipeline Development:
- Lead the development and optimization of data pipelines for efficient data collection transformation and loading.
- Implement ETL (Extract Transform Load) processes to support various analytical and operational needs.
- Utilize cloudbased technologies such as AWS Azure or Google Cloud Platform for data processing and storage.
- Performance and Scalability:
- Monitor and optimize data pipeline performance to ensure high availability and reliability.
- Develop solutions that scale with increasing data volume and complexity.
- Implement best practices for data partitioning indexing and caching.
Data Integration:
- Integrate data from diverse sources including databases APIs and thirdparty services.
- Ensure data quality and consistency across integrated systems.
- Team Leadership:
- Lead and mentor a team of data engineers providing guidance on technical challenges and career development.
- Collaborate with crossfunctional teams including data scientists analysts and software engineers to support datadriven initiatives.
Compliance and Security:
- Implement data security and privacy measures to protect sensitive information.
- Ensure compliance with relevant data governance and regulatory requirements.
- Documentation and Reporting:
- Document data architecture pipelines and processes.
- Provide regular reports on data infrastructure performance and issues.
Qualifications:
- Bachelor s degree in Computer Science Engineering Information Systems or a related field. Master s degree preferred.
Experience:
- 7 years of experience in data engineering with a focus on designing and implementing data pipelines in cloud environments.
- Proven experience with cloud platforms (AWS Azure Google Cloud Platform) and associated data services.
- Strong background in ETL processes data warehousing and big data technologies (e.g. Hadoop Spark).
Skills:
- Proficiency in programming languages such as Python Java or Scala.
- Experience with SQL and NoSQL databases.
- Familiarity with data modeling data warehousing and data lake concepts.
- Excellent problemsolving skills and the ability to work with large datasets.
Soft Skills
- Strong leadership and team management abilities.
- Effective communication skills with the capability to explain complex technical concepts to nontechnical stakeholders.
- Demonstrated ability to work in a fastpaced collaborative environment.
"If you are: bright motivated skilled a differencemaker able to get things done work with minimum direction enthusiastic a thinker able to juggle and multitask communicate effectively and lead then we would like to hear from you. We need exceptionally capable people for this role for our client so get back to us and tell us why you think you are a fit."
About Us:
TriForce is one of the fastest growing companies in Philadelphia region by receiving the award 5 times and 3 times(Ranked #) on Inc. 5000 fastest growing companies in the USA. TriForce Consulting Services Inc. is an established consulting services firm offering innovative solutions to Government and Commercial sectors. We specialize in building customized software applications solutions such as knowledge management systems business intelligence data analysis database support and maintenance data warehouse implementation and support systems architecture and systems integration for our clients. Our technical competencies are in Java.NET SharePoint PHP Business Intelligence (Cog nos Data Warehouse) mobile applications platforms (iPhone iPad Android Blackberry) and various other technologies. We also specialize in providing resources to manage infrastructure projects. TriForce is one of the fastest growing companies in the Philadelphia region by receiving the award 5 times and 2 times on Inc. 5000 fastest growing companies in the USA.
Skills: Proficiency in programming languages such as Python, Java, or Scala. Experience with SQL and NoSQL databases. Familiarity with data modeling, data warehousing, and data lake concepts. Excellent problem-solving skills and the ability to work with large datasets.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
