English

Google App Engine

App Engine Video Resources

Many Googlers have given talks at Google I/O and elsewhere about App Engine systems and best practices. Below is some of the video content available on the web.

Google I/O 2011

Below are all of the App Engine presentations from Google I/O 2011. These videos discuss new technology and best practices, and give you a glimpse in to running services in production.

Videos Summary Slides & Notes
App Engine Backends: Applications written on App Engine can scale to amazing heights, but have strict limits on processing time, cpu, and memory usage. App Engine Backends have few restrictions: they can use up to 1GB of memory, 4.8GHz of CPU, are individually addressable, and have no request deadlines. We'll dive into the new kinds of programs that Backends enable and cover best practices. Session Presentation


Session Notes
App Engine Mapreduce: It is now possible to run full Map Reduce jobs on App Engine. This talk will include a short introduction into running Map Reduce jobs. After that we'll dive into practical and algorithmic aspects of generating various reports with Map Reduce. Session Presentation

Session Notes
Building Enterprise Applications on App Engine: In its short three-year history, Google App Engine has evolved from its grass roots developer origins to a technology used more and more by global businesses. This session reviews App Engine’s history and explain how it will evolve to serve an increasing Enterprise audience. We'll cover specific technical milestones and discuss the future of App Engine. Several App Engine business partners will also be highlighted and will be on stage to explain how they’ve used App Engine in a business context and how they see using App Engine in the future. Session Presentation
Full Text Search: At last we are adding a full text search service to App Engine. The upcoming service will be built on top of the search infrastructure used by Google. In addition to full text search queries, we will also offer numeric, geo, date search, and much more. This session covers the basic full text search API, briefly outline more advanced features, and how full text search ties to existing services such as datastore Session Presentation

Session Notes
Fireside Chat with the App Engine Team: With Max Ross, Alon Levi, Sean Lynch, Greg Dalesandre, Guido van Rossum, Brett Slatkin, Peter Magnusson, Mickey Kataria, Peter McKenzie Session Notes
Coding For The Cloud: How We Write Enterprise Apps for Google on App Engine: Google's IT department builds the enterprise apps that run Google as a company. Come hear Google's CIO and engineers talk about what they've built and learn the tips, techniques and software design patterns that you can use to build applications on App Engine. Session Presentation

Session Notes
Life in App Engine Production: App Engine runs your application at scale, so you can focus on features and not sysadminning. But SOMEONE has to run those computers for you! Come meet them, find out what keeps them up at night, and hear hair-raising Tales of the Unexpected. Plus, a demo of new monitoring options for your application, and a dash of HRD advocacy. Session Presentation
Large-scale Data Analysis Using the App Engine Pipeline API: The Pipeline API makes it easy to analyze complex data using App Engine. This talk will cover how to build multi-phase Map Reduce workflows; how to merge multiple large data sources with "join" operations; and how to build reusable analysis components. It will also cover the API's concurrency model, how to debug in production, and built-in testing facilities. Session Presentation
More 9s Please: Under The Covers of the High Replication Datastore: For the first three years of App Engine, the health of the datastore was tied to the health of a single data center. Users had low latency and strong consistency, but also transient data unavailability and planned read-only periods. The High Replication Datastore trades small amounts of latency and consistency for significantly higher availability. In this talk we discuss user-facing and operational issues of the original Master/Slave Datastore, and how the High Replication Datastore addresses these issues. Session Presentation
Putting Task Queues to Work: Does your app require software that you can't run on App Engine? By using the brand new pull based queues, you can crunch through all sorts of work like OCR, video encoding, and image manipulation in a VM. Add work to queues using App Engine's Task Queue API and process the tasks in a VM by pulling from queues using the REST API. Pull queues open up a lot of new possibilities for your apps so come and hear from the team that built this functionality and bring your questions! Session Presentation

Session Notes
Scaling App Engine Applications: During this talk, we’ll discuss how to write highly scalable apps on App Engine. We’ll describe how an app is granted more instances as traffic grows, and the importance of low latency, low memory usage, concurrency, async APIs, load testing, and profiling. We’ll also help you avoid common pitfalls, like entity contention and hot tablets. Session Presentation

Past Google I/Os

Below you can find links to App Engine session at all the past Google I/Os. Please be aware that some of this information does not represent current best practices. However, it's a great view of the history of our platform.

App Engine at Google I/O 2010

App Engine at Google I/O 2009

App Engine at Google I/O 2008

App Engine at Campfire One

See how far we've come by watching both Campfire Ones on App Engine. In 2008, we launched App Engine at Campfire One. One year later, we held another Campfire event to introduce the Java runtime. The YouTube playlists below cover both events in their entirety.

Campfire One: Introducing Google App Engine

Campfire One: App Engine's 1st Birthday