Manuel Amador's résumé

by Rudd-O published 2008/11/11 19:05:00 GMT+0, last modified 2016-12-19T18:14:37+00:00

Introduction

I am a passionate, outgoing and accomplished professional looking for new challenges in the areas of site reliability engineering and devops.  I'm resourceful, skilled, confident, autodidactic, highly educated and experienced.  I've given conferences and lectures, started companies, developed widely used free software and written articles published in traditional as well as new media. I'm a user and developer of free software.

Free software has given me broad and in-depth experience of software and systems engineering (including Linux, ZFS, Python, Salt Stack, Go and Qubes OS); my experience with operations has given me the skills necessary to reliably orchestrate IT products and services from their inception to production rollout; my experience with running a business made me resourceful and gave me the opportunity to deal with people constructively.  My favorite types of challenges -- that is, what I'm particularly suited for -- are short-to-medium-term projects that require deep knowledge and laser focus, and I'm suited for them because of my superior ability to tap into the knowledge I've already acquired, acquire new knowledge, and put both to good use.

What I am looking for: I'm looking for a challenging SRE or devops position, preferably in either the United States or Switzerland.  I also have had a green card before, and I should be eligible for an H permit.  I have a current L permit which allows me to stay in Switzerland.

Contact and reference information

Mobile phone
+1 (408) 416-1586
E-mail
rudd-o@rudd-o.com
References
(upon request, for third-party privacy reasons)

Professional experience

Mentions only the most recent formal employment experiences, from most recent to earliest:

Google • online advertising / engineering firm
August 2013 — Today
Site reliability engineer.
  • Low-level / low-dependency planetary-wide job / task control: development, maintenance, and delivery (release / rollout) automation.
  • BigQuery massively parallel database: delivery engineering and automation.
Aditazz • engineering at the service of better buildings
November 2012 — August 2013
Senior development operations architect.
  • Conceived, deployed, documented and maintained uniform, fully version-controlled, multi-environment operations infrastructure:
    • Runs entirely in Amazon Virtual Private Cloud.
    • Leverages Opscode Chef and the Salt Stack for full automation.
    • Is version-controlled, maintained primarily in Github. Even in the event of the most infrastructure-crippling disaster, every single aspect of the infrastructure -- down to its very bootstrap -- can be brought back anew. The infrastructure's configuration / state is derived from the state of the infrastructure repository, and verifiable down to the SHA1 hash. Data for running services can be restored from backups.
    • Covers the entire lifecycle of each machine and each service, from boot/start to final poweroff/decommission.
  • Supervised and maintained all equipment involved in the operations infrastructure, through the mechanisms built into the infrastructure
  • Engineered, maintained and documented C++, Python and Go build infrastructure and continuous delivery for the entire software stack
  • Designed, drove, documented and deployed the service-oriented Web applications delivery platform:
    • Based on typesafe languages and clustered key-value stores.
    • Zero-downtime, horizontally-scalable, continuously-delivered.
    • All nodes involved in service provision are stateless and entirely disposable at any time.
    • Code upgrades get automatically distributed and atomically installed. Hot upgrades cause zero requests to be lost.
    • Configuration changes automatically apply to affected machines. Reloads cause zero requests to be lost.
    • Up to two database nodes out of three can be lost with zero data loss. Applications using the database recover automatically and remain unaffected.
  • Implemented automated backups for several key operations infrastructure components, entirely integrated into the operations infrastructure
  • Wrote a zero-downtime Web server library in Go, currently used in rapid development and deployment of Web applications
  • Wrote a Web server supervisor and proxy, currently in use for rapid local development of Web applications
StumbleUpon • the largest recommendation engine in the world
April 2012 — July 2012
Senior site reliability engineer.
  • Upgraded several NetApp servers by replacing them with off-the-shelf commodity ZFS on Linux servers.
  • Implemented automatic ZFS replication and incremental hourly, weekly and monthly backup between geographically separate datacenters.
  • Implemented ZFS on Linux data collection for OpenTSDB.
  • Implemented Varnish data collection for OpenTSDB.
  • Resolved, while on-call, several critical MySQL replication errors.
  • Integrated the deployment of ZFS on Linux and zfs-tools into the global StumbleUpon infrastructure, through Puppet automation.
  • Deployed the latest stable Bugzilla and its customized skin, fully automated through Puppet.
  • Implemented rate-limiting and compatibility with pv for ZFS replication in zfs-tools.
Twilio • massively scalable cloud telecommunications API
March 2011 — February 2012
Software engineer, development operations engineer.
  • Fixed long-standing defect in production enterprise bus that had cost the company thousands of man-hours. test suite
  • Developed new features and fixed compliance, both per the HTTP spec, for horizontally-scalabe transcoding service.
  • Participated in the Twilio Client team rollout.
  • Researched and produced cross-platform cross-browser plugin for Flash-less voice over IP communications.
  • Rewrote build system to be compatible with Git while maintaining Subversion support.
  • Developed the orchestration parts necessary to put Github FI (a private Github instance) in operation, and rolled it into production.
  • Automated test suite creation and execution, triggered by Git pushes to Github FI repositories.
  • Researched the use of kernel ZFS for higher-performance database clusters in Amazon EC2, and incremental backup / mirroring solution in production.
  • Developed a Sensu-based replacement for Nagios with both delegation and horizontal scalability in mind, that allows developers and teams to express monitors, error conditions, alerts, snooze criteria and response strategies, directly on the Git repository associated with their product, thus relieving the platform team from having to intervene manually each time a monitor needs to be set up.
  • Developed an entirely new service execution infrastructure based on LXC Linux Containers, to provide highly secure isolation between components executing in the cloud, and to execute the entire Amazon EC2-centric development lifecycle directly on a laptop. This infrastructure provides two overarching benefits:
    • It simulates networked Amazon EC2 instances, down to the AMI level, directly on developers' laptops, without the overwhelming memory or disk space cost of virtualization. Thus, it allows developers to test the entire life cycle of a product in their laptops, or multiple products collaborating together, without relying on actual EC2 instances, and running on the exact same operating system environment they would use in the cloud. It also allows developers to test their products with different AMIs or later builds of the same AMI, before they deploy the products in the Amazon cloud.
    • When the execution infrastructure is run directly in Amazon rather than in a local development environment, each product runs in its own strongly-isolated extremely-low-privilege (zero-capability) container, so malicious intrusions (even those that result in root escalation) cannot tamper with other services running in the same machine, or access highly sensitive and privileged credential information. Also, the execution infrastructure allows for extremely rapid rollout of different products in the same instance (faster than Amazon EC2 reservations), and each product can use a different underlying operating system rather than being limited to Amazon AMIs.
Skydera Inc. • cloud computing
October 2010 — March 2011
Software engineer, product developer, system administrator, SCM manager.
  • Implemented a real-time, high-performance data collection agent to aggregate collectd performance data and store it in a column store.
  • Implemented a real-time scalable cloud autoscaling algorithm to manage both on-demand cloud growth and costs.
  • Rewrote and re-engineered the entire analytics facet of the Skydera cloud computing management platform, making use of asynchronous JavaScript techniques, tools and charts.
  • Rewrote portions of the Skydera platform.
  • Implemented Git source code control system.
  • Wrote tests for several key components of the Skydera platform.
  • Implemented a highly-scalable asynchronous job manager and executor for cloud infrastructure provisioning.
  • Managed essential infrastructure servers and services
VMOps Inc (now Cloud.com, Inc.). • cloud computing
October 2009 — October 2010
Software engineer, product developer, free software developer, community manager, support engineer, release engineer, SCM manager.
  • Contributed to the OpenStack project.
  • Took the software distribution and turned it into CentOS / Red Hat / Ubuntu compatible packages.
  • Developed and published the cloud-tool, a Python-based, dynamically programmed, platform-agnostic command-line tool to drive any Cloud APIs.
  • Took on the process of submitting Fedora packages for inclusion of the open source CloudStack in Fedora.
  • Integrated the software distribution into the automated build system.
  • Redesigned the build system to be more compliant with practices in the free software world.
  • Built product packages for popular Linux distributions.
  • Took over the OpenSolaris distribution component.
  • Troubleshot and solved a wide range of virtualization, network and hardware issues.
  • Created the VMOps TechCenter, starting with the initiative, platform selection (Plone), going on to site organization, content, community policies and, finally, ending with content migration and publication.
  • Documented key aspects of Cloud.com's products.
  • Developed patent-pending product features.
  • Provided licensing advice regarding the free software release of Cloud.com's products. Developed a tool to properly and automatically license the open-source code and tools developed at Cloud.com, using heuristics.
  • Managed key components of the engineering infrastructure, including SCM, build software, and continuous integration systems.
  • Set equipment up in several datacenters.
  • Developed several CloudStack product tools, libraries and features.
  • Worked on the source repository control system, migrating it from Subversion to Git.
  • Planned and implemented the next-generation continuous integration infrastructure, from planning to roll-out.
GPLHost • virtualization and hosting
May 2007 — September 2009
Support engineer, system/network administrator, free software developer, build master, repo manager.
  • Managed over 30 Xen virtualization servers, with an average of 15 slices per physical server, together with all of the network services on the Xen servers and company-dedicated VPS instances.
  • Executed hands-on remote technical support for GPLHost dedicated and Xen virtual private server customers.
  • Dealt in relationships and network issues with upstream ISPs.
  • Migrated CVS infrastructure to Git.
  • Developed automation software to batch manage all equipment.
  • Designed and deployed secure backup strategy based on Dirvish for all nodes.
  • Reengineered automated deployment software for RPM-based Linux guests in Xen virtualization environments.
  • Deployed WAN network monitoring and alert plan based on Nagios2.
  • Wrote software to auto-deploy and configure the Munin monitoring system across the network.
  • Analyzed, proposed and deployed several SEO measures to optimize SERP position, based on statistical data collected by Google Analytics and a well-informed understanding of search engine technology.
  • Detected and stopped unauthorized intrusions ("hacker attacks") in real-time, then collected forensic evidence for investigative followup.
  • Provided the know-how and testing for a variety of POSIX systems applications and daemons (e.g. MySQmail).
  • Co-developed and enhanced the GPLHost software stack, consisting of a number of free software applications such as DTC and DTC-Xen, originally created (and to this day, mainly developed and stewarded) by Thomas Goirand.
  • Ported several components of the GPLHost software stack to CentOS, including DTC-Xen and DTC.
  • Automated and maintained CentOS / RPM packaging for the GPLHost software stack (including DTC, DTC-Xen and their dependencies).
  • CMS.
Amautacorp S.A.
April 2007 — August 2007
Software development consultant.
  • Audited software quality, supervised, chose technology and coded ground portions for a Web 2.0-based ERP system for Amautacorp S.A.'s customers.
  • Developed a script- and SCCS-based software quality metrics reporting system.
Independent contractor
July 2005 — Today
Software developer, support engineer.
  • Deployed and supported Linux servers for local companies.
  • Developed WordPress-based extensions and solutions for several one-time and repeat customers, under the banner of Turbocharged.
Amautacorp S.A.
January 2003 — July 2005
Cofounder and shareholder
Primary responsibility: information systems and platform management, research.
  • Chose and rolled out fundamental technology for the company's IT infrastructure.
  • Deployed an entirely Linux-based eight-seat office for internal use using LTSP and remote desktop technologies.
  • Developed in-house service with an HTTP / XML-RPC API, plus clients for the service, for secure e-commerce transactions.
  • Managed a leased dedicated server facility for Web presence and e-mail.
  • Co-managed a tier-1 consumer-oriented Web site running on our hardware.

Professional profile

In summary:

  • Site reliability engineering
  • Development operations and infrastructure (devops)
  • Systems administration
  • Software development
  • Free and open source software
  • Strategic IT infrastructure planning and roll-out
  • Software project management
  • Business management
  • Complex problem troubleshooting
  • Product development

Academic qualifications

High school
Until January 1998
High school diploma from the Colegio Alemán Humboldt de Guayaquil (Humboldt German school), focused on physics and math
Graduate studies
November 2006
Software engineer / information systems management engineer (with a marketing minor), diploma from Universidad Santa María, Guayaquil campus. Second-top grade average in class of '99, information systems division. 100% grade on my thesis Free software for developing countries.

Languages

Spanish
Native language.  Natural command of the language and extended vocabulary.
English
Seven years of English in school, plus business English courses provided by Universidad Santa María under outsourcing arrangement with STOES.  Natural command of the language and business / technical vocabulary.
German
Sprachdiplom I (1995) and II (1997) granted by the German government (Deutsche Kultusministerkonferenz), after ten years of German language classes in school.  Highest Sprachdiplom II grade in class of 97/98 for Deutsch als Fremdsprache (German as a foreign language).   Attended Deutsch als Muttersprache (German as first language) classes for one year.

Professional skills in the IT field

Every single item mentioned in this section is backed by raw, practical everyday experience.

Overview

  • Cloud services
  • Systems and process automation
  • Systems and network troubleshooting and problem resolution
  • Software configuration management (SCM)
  • Signal / audio analysis and processing
  • Prevention of malicious attacks and intrusions -- knowledge of techniques and practices
  • Software development
  • Project planning and execution
  • Quality management

System administration and troubleshooting toolsets

  • Salt Stack, Puppet, Chef and Ansible configuration management and automation
  • ZFS (in particular the ZFS on Linux implementation)
  • OpenTSDB
  • The entire OS troubleshooting chain of Linux systems:
    ptrace, strace, oprofile, ltrace, sar, top, and gdb
  • Wireshark, nmap, ntop and iftop for network troubleshooting
  • Both RPM and Debian package management systems plus repository maintenance tools
  • Administrative experience with a variety of file systems and volume management tools (including ZFS) on Linux
  • Amazon EC2 and S3 expertise
  • Cloud.com CloudStack expertise
  • OpenStack expertise
  • LXC Linux Containers expertise

Computer languages and software development tools

  • Python
  • Bourne shell and Bash
  • PHP
  • C and C++ (through the GNU compiler collection)
  • ANSI SQL
  • Java
  • Twisted
  • Qt
  • GTK+
  • KDE libraries and technologies
  • Deep expertise with POSIX (Portable Operating System Interface)
  • The entire RPM build and release (repository) toolchain
  • Most of the Debian build toolchain

Operating systems

  • Linux: LAN/WAN operations, software development, terminal services and enterprise-level service management, since 1997. Linux, its applications and services are my solutions of choice for software development, services and solutions
  • DOS and Windows: management, deployment and configuration (up to Windows NT 4), since 1993 (Windows 3.1) and before (from MS-DOS 3.3 to MS-DOS 6.22)
  • Heterogeneous virtualization environments: Xen, KVM and VMWare

Networking

  • Planning and construction of wired and wireless Ethernet networks
  • Diagnosing and troubleshooting network availability and congestion problems
  • Auditing network security
  • TCP/IP and traffic analysis
  • LAN virtualization with VLAN-based technology
  • Cisco ASA-based firewalling and routing
  • iptables-based firewalling and routing
  • OpenVPN

Network and application services

  • Comprehensive understanding of the HTTP spec
  • Windows/Linux file/print services through SAMBA
  • E-mail services through Sendmail/Postfix, Dovecot/Courier and secure services through SASL/OpenSSL
  • Web server management and tuning: Apache, Squid, Varnish
  • Source code control systems: git, Subversion and CVS
  • Trac, as a project management and SCM tool
  • Networking supervision and audit (Nagios, Wireshark, nmap and other tools)
  • Terminal services (the entire range: from programming boot ROMs to full configuration of LTSP and competing environments such as NX)
  • Relational databases based on ANSI SQL (PostgreSQL, MySQL, SQLite)
  • Intranet development
  • Directory services (OpenLDAP)
  • Firewall management (through iptables, higher-level tools and proprietary hardware such as the Cisco PIX and ASA security appliances)
  • Network block devices and ATA over Ethernet
  • Migration to fully free software infrastructures

Web

  • Complete understanding and experience of modern Web standards (XHTML 1.1, CSS 2.1, JavaScript/XHR, RSS2 and Atom)
  • Development, deployment and customization of generic intranet services based on free software
  • Search engine tuning

Office automation

  • Expert user of the OpenOffice.org suite.
  • Expert on Microsoft Office since Microsoft Word 2.0 and Excel 4.0, through Microsoft Office 2003.

Computer hardware

  • PC construction and repair
  • Hardware conflict troubleshooting

Business and social intelligence skills

  • General accounting
  • Human resources management
  • Leadership
  • Business administration
  • Information and communication technology management
  • Reengineering of systems and processes
  • Organizational process modeling
  • Finance and economic engineering
  • Numerical methods
  • Conflict resolution
  • Copywriting (English/Spanish)
  • Simultaneous translation (English/Spanish)

Public activities

Business

  • Development and sales of free software and engineering services through Turbocharged (blog and niche Web marketing-oriented CMS).
  • Cofounder and minority shareholder of Amautacorp S.A., whose leadership was recognized by widely-circulated Ecuadorian entrepreneurship ENSAGA magazine.

Articles

Conferences

  • Opening speaker in Hackers, seguridad y redes, sponsored by Ecuadorian Internet company WebWorks interactive media, October 1999, Guayaquil/Quito, Ecuador
  • Free software: democratization of access to public information, talk part of the InfoDesarrollo event in Auditorium 2 of ESPAE (economic and political sciences faculty) in campus Las Peñas of the local Polytechnic university, ESPOL, September 13 2005, Guayaquil, Ecuador
  • Quality in free software projects, talk part of the event named Software quality in Ecuador, in Universidad Santa María, campus Guayaquil, September 30 2005.

Free software

I'm bound to the free software movement (generally as an author) through the following projects (also see my Github profile):