Data Software Engineer, AgeLab
Working at MIT offers opportunities, an environment, a culture – and benefits – that just aren’t found together anywhere else. If you’re curious, motivated, want to be part of a unique community, and help shape the future – then take a look at this opportunity.
DATA SOFTWARE ENGINEER, AGELAB, Center for Transportation & Logistics, to support naturalistic and simulated advanced driving technology research. Will manage a growing dataset comprised primarily of video and tabular sensor data housed on remote servers and databases. Will be responsible for working with data through various software components of a growing data pipeline including activities; leveraging and expanding existing processing pipelines for the SLURM workload manager hosted on a remote academic computing cluster (MGHPCC) running CentOS 6 and 7; managing secure storage and access for hundreds of terrabytes of data while providing data support for local researchers and remote sponsors; working with an existing PostgreSQL database for storing metadata and design new storage schemas on a per-project basis; maintaining/leveraging existing preprocessing code and synchronization scripts that preparing video and time series data for analysis by researchers; developing/integrating third-party annotation approaches into data processing pipelines to augment and transform data; evaluating and developing new computing resources as needed; implementing backup routines; generating documentation; and other duties as requested.
REQUIRED: bachelor’s degree in related field; at least two years’ programming experience (may include experience gained as an undergraduate) in a Linux environment using Python and/or C/C++; six months’ professional experience writing software or managing data; experience with relational databases (e.g., PostgreSQL) and managing large complex data; meticulous attention to detail; strong problem-solving, time-management, communication, and organization skills; and ability to manage multiple priorities, work as part of a team, quickly learn new software programs/interfaces, and troubleshoot minor technical problems. Experience with data and network security and knowledge of and interest in working with vehicle-based data preferred.
MIT is an equal employment opportunity employer. All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, sex, sexual orientation, gender identity, religion, disability, age, genetic information, veteran status, ancestry, or national or ethnic origin.