Baidu expects autonomous buses to become first wave of self-driving vehicles

Chinese search engine Baidu has entered the race for self-driving vehicles in 2014. In a partnership with BMW, the company presented an early prototype of an autonomous car at the end of 2015. Baidu’s approach mimics Google in many ways: Like the first Google prototypes of 2010, the car uses the (aging) Velodyne 64 Lidar as its main sensor; Baidu’s approach also relies on detailed mapping which fits well with Baidu’s overall mapping strategy. Baidu also aims to diversify its business model by leveraging its know-how in artificial intelligence and has transferred its auto-related activities into a separate division, a move that Google started last year by restructuring into Alphabet. There are some differences: unlike Google, Baidu does not seem to put much emphasis on the sensors; they don’t seem to experiment with their own sensors and the configuration of sensors indicates that certain situations in which a car may find itself have not been considered yet.

Baidu’s vision of how self-driving vehicles will be adopted also differs somewhat from Google. Whereas Google has focused on individual cars, and is testing electric two-seaters which could easily become robotaxis, Baidu expects the first wave of self-driving vehicles to be autonomous buses or shuttles. In a recent online interview, Andrew Ng, Baid’s Chief Scientist, argued that buses which service a fixed route or a small defined region will be the best starting point. He expects a large number of such vehicles to be in operation within three years (= early 2019) and mass production to be in full swing within five years (= 2021).

Andrew Ng correctly pointed out that such autonomous buses operating on fixed routes or small regions  would have the advantage that care could be taken to ensure that the routes are well maintained, don’t have construction (or the construction site is clearly indicated in the map) etc.

Unfortunately, Andrew Ng’s argument, that driving on predefined routes would enable the vehicles to avoid “corner cases–all the strange things that happen once per 10,000 or 100,000 miles of driving” (source) is flawed. He argues, that machine learning can not prepare for these corner cases and that therefore driving in a restricted well-defined environment is the solution. Unfortunately, corner cases can happen anywhere; it is impossible to guarantee that on well-mapped and well-known routes strange situations can not occur. Pedestrians can suddenly appear in areas that are closed for pedestrians, obstacles may occur on a road, an oil spill can occur, the road can suddenly be flooded etc. Building software that can reliably handle even the most challenging situations is a hard task and needs to consist of a combination of machine learning, an enormous testing program (usually combined with knowledge acquisition and machine learning), careful and very extensive risk analysis and risk modeling, and purpose-built test scenarios which challenge the capabilities of the cars both in simulators and in staged test cases in the real world.

We have pointed out for the past five years that the switch towards shared mobility services based on fully autonomous vehicles will be the great transformation that self-driving car technology will bring. This is the reason why auto makers have been so reluctant to push fully autonomous driving and why it provides avenues for new entrants such as Google, Baidu, EasyMile, Bestmile, Zoox, potentially Apple, and others to capture a significant share of the world’s expenses for personal mobility. There are many reasons why the first fully autonomous vehicles to appear on our roads will be robo taxis or self-driving buses, not the least that many current projects focus on such autonomous mobility services. Examples are: WEPods (Netherlands), CityMobil2 (Greece and EU), One-North (Singapore), Sentosa (Singapore), EasyMile, (USA, California), Google self-driving pods (United States, California and Texas), Milton Keynes driverless pods, (United Kingdom), Ultrapods (United Kingdom), Bestmile (Switzerland), DeLijn, (Belgium), RobotTaxi (Japan), Baidu (China), Yutong Bus (China).

In summary, Baidu’s focus on self-driving buses adds weight to the expectation that shared mobility services based on driverless pods and buses will drive the initial adoption of autonomous vehicles. Both self-driving cars and buses have to solve the problem of autonomous driving and the same technology can applied for both application scenarios. This is why the technology which Google currently refines with their 53 self-driving cars can easily be transferred into self-driving buses and shuttles and why Baidu’s current prototype is not yet a bus but rather a converted BMW. Those pioneers who solve the problem of fully autonomous driving will find enormous business potential for self-driving taxis, self-driving shuttles, self-driving consumer cars, trucks and machines. The race is on!

Self-driving cars will be a potent weapon to combat climate change

Although world leaders have reached a ‘historic’ agreement on climate change at the Paris Summit, good solutions to reduce greenhouse gas emissions remain hard to find. Fortunately – and counter-intuitively – self-driving cars have the potential to significantly reduce the ecological footprint of transportation:

The transportation sector is a major polluter and it is the economic sector with the biggest net effect on climate change. While some other sectors (such as industry and power generation) emit more greenhouse gases, these industries also emit other substances that lead to cooling (aerosols of sulfate, nitrate and others).

Of course, self-driving cars will not reduce the number of trips or kilometers traveled. On the contrary: self-driving cars have the potential to significantly lower the total cost per kilometer traveled and are thus likely to induce people to make more trips. As we have shown in other papers, self-driving taxis and buses will emerge rapidly and offer mobility services for local and long distance traffic with great convenience and at extremely competitive prices because they can achieve much higher utilization rates than private cars (which stand idle more than 94% of the time), and because autonomous fleet vehicles will be engineered for the minimization of total cost of ownership and for the maximization of useful life.

Most urban self-driving taxis will be fully electric for reasons that are not primarily environmental but that are still good for the environment: Electric motors offer safety advantages (they can be used for emergency braking and to some degree for emergency steering). They are also much more durable (an electric motor easily lasts 1 million kilometers), less expensive and less complex than conventional engines. In addition self-driving taxis that operate in local traffic will not need huge battery packs when average trip sizes rarely exceed 15 kilometers and when they can drive themselves to the next high efficiency charging station as needed. Their batteries won’t be sized to last a whole day; they will need to be just large enough to service a little more than the trips of the morning peak – after which they can recharge.

There can be no doubt that self-driving taxis and buses will change the nature of urban mobility. Much more short-distance travel than today will occur in small, lightweight, extremely energy efficient self-driving taxis. Although this may lead to a certain increase in total miles traveled, the following effects combine to reduce greenhouse gas emissions:

  1. Self-driving taxis will be mostly electric which reduces carbon emissions (approximately 25% less emissions compared to internal combustion engine)
  2. Self-driving urban taxis will be smaller and much lighter than the average car which further reduces energy consumption per kilometer
  3. Self-driving taxis reduce demand for private cars and therefore reduce the sizable greenhouse gas emissions during vehicle manufacturing which are typically more than 10% of total life-cycle emissions of a car. According to some estimates, a self-driving car-sharing vehicle or taxi can eliminate 7 to 10 private cars. What a potential for greenhouse gas reduction in auto manufacturing!
  4. Self-driving taxis facilitate multi-modal travel (taking an autonomous taxi to the train or bus station, continuing with bus or train, using an autonomous taxi for local transport at the destination)
  5. Self-driving taxis facilitate ride sharing especially during peak hours and on certain routes.

On the other hand, the effect of self-driving taxis on public transport is not yet clear. There is both the risk that some local trips which are taken by public bus today will migrate to self-driving taxis and the opportunity to capture a much larger share of the mobility demands with self-driving scheduled and on-demand buses and mini-buses – potentially in multi modal combinations. The potential benefits are large and there will certainly be a place for efficient self-driving mobility services using self-driving buses and mini-buses. Concerns that new mobility solutions centered around self-driving taxis and mini-buses will be less environmentally efficient than current scheduled buses are not warranted because today’s scheduled buses are not very good for the environment during off-peak hours when they travel near-empty.

The currently most overlooked aspect of self-driving vehicles is their effect on medium and long-distance travel in areas with sufficient population densities. Whereas today many people choose their own vehicle for distances between 100km and 500km self-driving taxis and self-driving buses make it much easier to provide excellent, extremely cost efficient long distance mobility services. When urban taxis at both origin and destination guarantee painless individual personal mobility and when small or medium-size autonomous buses provide long distance travel at extremely low rates which are much lower than the cost of traveling in a private car, then greenhouse gas emissions can be reduced very significantly. Although only a small percentage of all trips are more than 100km in length, these trips represent a large share of the total distance traveled in private cars and therefore have a large and easily overlooked potential for reducing greenhouse gas emissions.

The big advantage of self-driving car technology is that it can accomplish several benefits at the same time: It increases the options for individual mobility and lowers the cost of individual mobility because of new driverless mobility services which through increased sharing, more efficient use and quicker adoption of alternative fuels reduces greenhouse gas emissions. Nobody will have to abandon their cherished car but the joint actions of the large group of less or only moderately affluent consumers who value the flexibility and cost-saving associated with self-driving mobility services will inexorably lead to a reduction of greenhouse car emissions. It is time for the political leaders searching for solutions to combat climate change to take notice!

Chinese company unveils prototype of self-driving bus

After three years of development, one of the leading Chinese bus manufacturers Yutong has sent the prototype of a self-driving city bus on a 32 km long circuit on an intercity road between Zhengzhou and Kaifeng in Henan Province. The bus drove the whole track in regular traffic without any human assistance, attained a peak speed of 68 km/h, passed 26 traffic lights and was able to change lanes and overtake autonomously. This is a significant accomplishment and clearly puts Yutong on the map for autonomous driving.

The bus is equipped with many sensors, including camera and Lidar. Two Lidar sensors are strategically placed in the middle of both sides of the car. This is the best way to monitor the adjacent lanes and mimics the approach Google has taken on their driverless pods (where the side Lidars protrude like the mirrors of conventional cars).

2015IBKCjHF7im

Image source: Yutong, 2015.

The company’s press release points out that significant additional development is required. No further information about the timeline for the introduction of such a bus was provided.

Self-driving buses are very promising and will be a key ingredient of future mobility. On demand-buses will be able to service the complex mobility demands of our societies much better than today’s mix of scheduled buses, trains, and individual cars. They will lower the cost, resource consumption and ecological footprint of mobility. Because significantly lower costs will prompt many travelers to use buses on medium to long-distance trips instead of cars, these buses will increase the effective capacity of highways when measured in people-miles.

 

Source: Yutong Bus Company, Dailymotion video

Update 2016-02-21: The bus traveled between Zhengzhou and Kaifeng in Henan Province. The approximate route can be looked up on Google maps.

Five guiding principles for autonomous vehicle policy

As self-driving car technology matures, politicians and regulators find themselves called to action. But the technology is a moving target and views about the technology’s path and impact vary widely. So how should policy makers approach the subject? Here are five guiding principles proposed by Marc Scribner,  a transportation and telecommunications policy specialist and research fellow at the Competitive Enterprise Institute. Scribner only discussed the principles briefly at a recent presentation at the Cato Institute. In the following I supplement each of his five bullet points with my interpretation:

1. Recognize and promote the huge potential benefits of self-driving cars

Policy makers need to familiarize themselves with the potential benefits of self-driving cars. First, they need to get the concepts right and clearly distinguish self-driving cars (which can drive without human supervision, even empty, and don’t need additional infrastructure) from other technologies such as driver assistance systems and connected cars. Connected cars and driver assistance systems are certainly also interesting topics but their benefits pale in comparison to the benefits of cars that drive themselves. Besides greatly reducing accidents, self-driving cars also bring individual motorized mobility to those who do not have a driver’s license – including people with disabilities and the elderly. They reduce energy consumption, simplify the introduction of alternative fuels and reduce the load on the road infrastructure.
Policy makers need to recognize that self-driving cars can solve or greatly reduce many longstanding problems. This is not a technology where a wait-and-see attitude is warranted. Politicians need to actively promote this technology. Of course, this does not mean that the technology’s risk should be ignored.

2. Reject the precautionary principle

Safety is a key concern and a key benefit of self-driving cars. There is good reason to expect mature self-driving cars to drive much safer than humans. They are equipped with 360 degree sensors, including cameras, radar and Lidar, are always alert, never tired, don’t drink and adopt a defensive, risk-minimizing driving strategy. But letting the first such cars drive by themselves on public streets is a difficult decision: what if anything goes wrong?
The application of the precautionary principle avoids this situation by requiring the developer to prove that the car is harmless. Unfortunately, proving that a self-driving car is safe is a hard problem and strict application of the principle could significantly delay the introduction of self-driving vehicles.
This weakness of the precautionary principle is well-known: There is the risk that erring on the side of caution when certifying self-driving cars prolongs the current carnage on our  on our roads. Unfortunately, we don’t have the luxury to delay a well-functioning self-driving car for a few more years to be extra-sure that everything is perfect when 33,000 people die in traffic accidents per year in the US alone and more than 1 million per year worldwide.
As much as it is not acceptable to let first prototypes roam the streets unsupervised it is not acceptable to delay and delay just to be on the safe side. A middle ground must be found. This is not an easy task for policy makers but one on which lives depend.

3. Don’t presume to know how the technology and law will evolve

Will autonomous vehicle technology gradually evolve from driver assistance systems? Will they first appear on the highway or in low-speed local settings? What new business models will emerge and what role will machines play? Will the US be the first to legalize fully autonomous vehicles or does the Vienna Convention on road traffic really prevent many European Countries from adopting self-driving vehicles? There are so many paths that this technology can take, so many changes in many different areas of business and society, so many proponents and possibly opponents that it is hard to be right about the path of technology and – consequently – of law. It is very dangerous to assume that the technology will evolve in one way, then regulate for this situation and subsequently find that the technology evolves very differently.

4. Let the innovators innovate

This section was originally entitled ‘minimize legislative and regulatory intervention’ and included the goal to give the innovators the space to innovate. But here I differ with Scribner: Unfortunately, transportation law is so much based on the concept of vehicles driven by humans that many laws do need to be changed. Current traffic laws contain so many elements that inhibit progress for this new and safer technology. Autonomous vehicles change the concept of what a car is and the laws need to be updated accordingly. Otherwise innovators will find it hard to make progress. This is a task that should be started immediately – before fully autonomous vehicles are ready for public roads.

5. Preserve technology neutrality

Laws and regulations should be technologically neutral. As much possible, they should avoid favoring a specific technical approach.

Autonomous cars: Breakthrough for electric vehicles

Download PDF

Rethinking mobility

Sometimes the breakthrough for a new technology does not materialize in one of those fields which receive most attention and where everybody expects the solution. When the British needed a practical method for determining a ship’s longitude in the 18th century, they spent many decades gazing at the stars, compiling lunar tables and searching for astronomic methods for determining longitude. But the breakthrough came with an entirely different technology: an extremely precise clock! Longitude could now be determined quickly and easily by comparing the clock’s Greenwich time with local time (which can be calculated by tracking the rise of sun).

Download PDF

Today, electric mobility is in a similar situation: Billions of dollars have been invested in improving the usual components for electric vehicles: Battery technology – already quite advanced – is being perfected; charging infrastructures are being deployed; production processes are optimized and many of the legal and financial obstacles have been removed. Nevertheless, a real breakthrough is not in sight. As armies of engineers work on these problems, a much smaller group works on another technology which at first glance is not related to e-mobility: They develop autonomous vehicles that can drive themselves on regular roads and don’t require human input or modifications to the road infrastructure.
Only a deeper analysis shows how important fully autonomous vehicles will be for e-mobility: This technology changes fundamental aspects of mobility and enables alternative mobility scenarios which are more compatible with electric vehicles and where the biggest disadvantage of electric vehicles – their limited range – are much less of a concern. Range matters only in the current configuration of individual mobility which is based on individually-owned cars. If mobility is provided by fleets of driverless cars, then range limitations are no longer a problem because urban trips have an average trip length of less than 10km. They are much shorter than the range limits of current electric vehicles. Thus e-mobility may not need a breakthrough in vehicle range at all. It is sufficient to find new ways for reducing the range requirements for the vehicles!

Electric vehicles become competitive

Currently self-owned or leased cars are the cornerstone of individual mobility. Only a very small (even if growing) share relies on car-sharing and rental cars. These alternative mobility solutions currently have a big disadvantage: Every customer faces the problem of getting to the next available car and where it should be dropped off at the end of the journey. Once cars are capable of driving without any human intervention, however, this problem vanishes. Anybody will be able to request an autonomous vehicle by phone or mobile app. Within minutes a car will arrive to pick up the passenger and drop him off at the destination, where the car will then be ready to service the next customers.

Thus autonomous vehicles will initially provide the conditions for a breakthrough of car-sharing systems and autonomous mobility service providers. Compared to self-owned cars, they can provide individual mobility with a comparable level of service and comfort, and – because of better utilization and fleet optimization (see further below) – at significantly lower cost. In densely populated areas autonomous cars will therefore ensure that car-sharing systems greatly increase their share of individual motorized traffic.

This establishes the conditions for the breakthrough of electric vehicles. As part of fleets of autonomous vehicles, the advantages of electric vehicles can now be brought to bear: more robust and longer lasting motors, lower drive train complexity, lower service costs and lower emissions. Their shorter range is no longer a problem because fleet operators can dispatch vehicles that precisely match the mobility demands of their customers (local vs long-distance trips, number of passengers, baggage size etc.). As the vast majority of trips are local and short-range, most trips can be serviced with electric vehicles. A smaller number of fossil fuel vehicles can be used for long-distance trips. Thus fleets are likely to consist mostly of small electric two-seaters; only a smaller part will consist of larger vehicles or rely on fossil fuels. This potential for demand-based fleet optimization is a novelty that is only possible when cars can drive themselves to the customer. In this way total costs and resource consumption related to mobility can be reduced significantly.

Of course, fleets of autonomous cars do not have to use electric vehicles. However, there are three good reasons besides those already discussed above, why electric vehicles are particularly well suited for the first fleets of autonomous vehicles:
1) The first fleets with fully autonomous vehicles will appear in niche areas where it is easiest to control risk. Their speed and range will initially be quite low. At first, they may even travel partially on their own lanes and only later will increase their capabilities. An example is the project in Milton Keynes where 100 autonomous electric vehicles will be installed between 2015 and 2017 to ferry people between train station and city center. The requirements for these vehicles with respect to range, maximum speed, number of seats etc. differ markedly from the requirements for traditional cars. Current car models therefore do not constitute a good match for the first autonomous car fleets – even if they had been adapted for fully autonomous operation. At the same time, car manufactures are probably not eager to develop specialized low-volume models for use in early autonomous car fleets.
2) Current car models of the auto industry are not suitable for fully autonomous operation – even those with advanced driver assistance systems. They must be modified for pure fly-by-wire operation. All safety-critical components and systems have to be redundant. The modifications used in current prototypes and test vehicles are not suitable for productive use. It it is not at all trivial to adapt current car models for fully autonomous operation. Therefore the auto industry needs to develop a new vehicle platform from the ground up for fully autonomous operation. This could be a complex and time-consuming effort which will take longer than many fleet operators will be prepared to wait for.
3) The design and production of a small number of fully autonomous electric vehicles for local transport as part of fully autonomous fleets is much faster and easier than the design and production of classical cars adapted to the needs of fully autonomous mobility service providers. The complexity of electric vehicles is lower; relying on electric propulsion simplifies the redundant layout of all safety critical components. As an example, an electric motor has inherent safety benefits: It can be used for braking; if the motors are integrated into the wheels they could even play a role in emergency steering.

Whereas currently the lack of a national charging infrastructure for electric vehicles is often cited as a major problem, this problem also goes away when fleets of driverless urban cars are used. Because these vehicles are only used in local traffic in a specific region, it is sufficient to deploy the charging infrastructure for exactly that region and the actual number of electric vehicles and actual mobility demand. The infrastructure can then grow in synch with the fleet; it is no longer necessary to build up large infrastructures long before the first electric vehicles are placed into operation.

Economic pressures accelerate the transformation

Some innovations trigger intensive economic and societal changes which can advance with astonishing speed if they significantly change the cost structure and efficiency of processes. The power loom and the railroads are only two examples that highlight the potential dynamics.

Market forces work especially well, when they are brought to bear on inefficiently used capital-intensive resources. Such inefficiencies are very pronounced in transportation: Cars are among the largest single investments of private households; but their average utilization rarely exceed 6% – an incredible waste of capital. Therefore the potential for savings is enormous. The average US households spends more than 16% of its total expenses on car-based transportation.

A study of the Earth Sciences Institute at Columbia University has analyzed the savings potentials associated with fleets of self-driving cars in detail. They performed a simulation study based on the mobility patterns of Ann Arbor, a medium size city in Michigan which had about 285,000 inhabitants and 200,000 cars in 2009. 120,000 of these cars were used primarily for local traffic. Each day, 528,000 local trips occur in Ann Arbor with an average trip length of 9.3km and about 1.4 passengers per vehicle. The authors found that a fleet of 18,000 autonomous vehicles would be sufficient to satisfy the local mobility demand in Ann Arbor and ensure that no passenger would have to wait more than 60 seconds for their car – even during rush hours. This translates into a reduction in the number of cars by almost a factor of 7! Whereas a privately owned car with a range of 16,000km per year leads to costs of 0.46$/km, the fleet of driverless cars would reduce the costs per passenger-km to 0.25$. The study also examined the use of light electric vehicles instead of mid-size sedans which are typical used for car rentals. With electric vehicles, the costs would fall even further to 0,09$ per passenger-km. This is a cost reduction by a factor of five!

Although the study has not included all potential savings (not included were savings related to parking, congestion, aggregation of mobility demand, freed-up time) it clearly shows that this innovation has very high savings potential and can lead to a large increase in spending power for the individual. Even if not all consumers act rationally at all times, these calculations imply that a large number of households will choose autonomous mobility services instead of buying their own car in the future (we subsume the special case where a household purchases their own autonomous car but then rents it out to others as another variation of the fleet model). Only a smaller number of households will value the prestige of their own car or their love towards a car high enough to continue owning a car.

Another factor which will accelerate the growth of fully autonomous mobility providers is that even households which own a car will become customers of autonomous mobility services because they need their services in some situations: when a member of the family needs to be picked up somewhere, when multiple members of the household need to drive to different locations but the household does not have as many cars, when flying to other cities, etc. More and more people will then find that they can get around quite well without their own car. The number of situations in life where owning a car is almost a necessity will dwindle. Today there are many people for whom their own car is the only realistic way for getting to work. Fleets of driverless cars will greatly reduce such cases and therefore reduced the perceived need to purchase a car.

Paths towards new mobility

The transformation of mobility caused by fully autonomous cars will require some time. Despite the large advances of the last 30 years and the impressive prototypes which have been demonstrated by car manufactures (Daimler, Audi, Nissan), research institutes, Google and others, significant hurdles remain until fully autonomous cars will be able to drive on all roads without human intervention.

Currently there are two different visions of the path towards full autonomy. The conventional vision  assumes that autonomous technology will gradually evolve towards more and more advanced driver assistance systems until finally reaching full autonomy. It uses the typical diffusion process of automotive innovations (such as airbag and anti-lock braking) as a reference and assumes that the technology will slowly trickle down from the premium models to the middle-class models until it becomes standard for all new cars. However, there are significant hurdles – including regulatory problems – on this path. Several generations of models with ever more advanced driver assistance systems, with complete fly-by-wire and redundant layout of all safety-critical systems will be needed until models with full autonomy will appear on the market. If we follow this line of reasoning, then it may be well after 2030 that such cars are available in larger numbers and a decade or two more until fully autonomous technology is available in most cars. In addition, electric vehicles do not feature on this path, because it is based on personally-owned vehicles where range limitations of electric vehicles will continue to be a major problem.

However, there is a second path toward full autonomy which does not adhere to the standard car industry model of technology diffusion. Instead of trying to gradually integrate the technology into consumer cars, this path seeks to capitalize on the inherent advantages of full autonomy and targets those niches where full autonomy has the largest impact and can be implemented with a minimum of risk. We have seen above that full autonomy can greatly reduce mobility costs by providing mobility as a service using fleets of self-driving cars. A natural path towards full autonomy therefore starts with small, short range and most likely electric vehicles that provide local mobility at low speeds and in increasingly less controlled environments. The challenge for the pioneers is to find those settings which are best suited for limited, low speed operations of autonomous vehicles and which provide the best environment for their growth.

There is no shortage in candidates. Several systems with very low autonomy are already in operation: The ‘UltraPods’ at Heathrow Airport are electric autonomous four-seaters which ferry passengers between Terminal 5 and a parking lot. They run on separate lanes and use transponder chips embedded every few meters in the lanes for determining their position accurately. They also rely on internal lane maps for navigation. A similar approach has been adopted in the Netherlands where 6 autonomous electric buses carry people along a stretch of about 2km. A next step for such systems is to leave the confines of separate lanes at least in some cases and merge with regular traffic. Such an approach is planned for Milton Keynes, a British city, where 100 electric autonomous vehicles will be installed between 2015 and 2017 to transport people between the train station and the city center at low speed. Initially these vehicles will run on dedicated lanes (taken from current sidewalks); by 2017 they will expand their range and will be able to share lanes with pedestrians (there are currently no plans to put these cars onto the streets). This project has the advantage of minimizing risk while at the same time advancing the envelope of autonomous vehicles: algorithms will be perfected; approaches for the operational management of distributed fleets of self-driving vehicles will be developed; customer experience, preferences and service valuation will be understood better, a vehicular platform and technology architecture will be developed.

There are many areas where autonomous electric vehicles with even this limited capability are useful and can become economically viable very quickly. Similar approaches can be implemented in many cities where electric cars or buses may be installed for specific routes. Initially some infrastructure measures (such as separate lanes, fences which keep pedestrians away from the street, external sensors at critical locations) may be adopted; as experience and intelligence of the vehicle increases, these infrastructure measures can become obsolete.

Another variant of this approach would be if car makers or Google decided to implement their autonomous technology in a fleet of electric city vehicles that would operate on carefully selected routes in a suitable city. There are many ways in which this could unfold but there is no shortage of possible approaches for starting on a growth path for such fleets of autonomous electric vehicles. As the Milton Keynes Project shows, this is possible even with limited budgets.

Another advantage of this second path is a legal issue: A fleet of self-driving cars can be regarded as an intelligent transport system where the vehicles run on exactly specified paths. For such systems the legal limitations of the Vienna Convention on traffic which requires that every vehicle must be controlled by a driver at all times do not apply. This eliminates key legal problems which probably exist in countries which have ratified the convention (not ratified by: US, UK, Spain, China, Singapore and others). Even if the question has not been finally clarified, it is clear that countries have a considerable margin of interpretation which allows the implementation of fleets of driverless vehicles already today.

Overall, this alternative path to autonomous technology based on fleets of electric vehicles used for niche applications in controlled settings for urban local mobility is much more realistic and faster to implement than the vision of a universal fully autonomous car which can be used on all roads by anybody.

Conclusion

We are at the start of a development which could very quickly become an avalanche. Two years ago autonomous vehicles were widely regarded as utopian; by now it is clear that it is just a question of a few years until these vehicles appear on our roads. Right now, the view is still predominant that autonomous technology will do little to change the nature of cars and the nature of mobility. But a closer look reveals that the technology will lead to fundamental transformation from individually owned cars to mobility as a service and from mostly fossil fuels to electric vehicles. These fundamental changes hold many opportunities. Now is the time to take them…

Download PDF

RAND report on autonomous vehicles

As policy makers are waking up to the potential and issues related autonomous vehicle technology, the US think tank RAND Corporation has released a comprehensive report which analyzes driverless car technology from a policy perspective. The report looks at costs and benefits, the state of the technology, current legislation, liability and concludes with recommendations for policy makers.

Rand-Study

The report wavers between more incremental, functional perspectives (where autonomous technology is seen as an incremental improvement of current cars with little change to patterns of car use and ownership) and transformational perspectives (transformation of mobility, fully autonomous vehicles, fleets of driverless taxis). On one hand, the authors point out that the technology may enable developing countries to  “leapfrog autonomous vehicle technology” and “skip some aspects of conventional, human-driver centered travel infrastructure”. They point out that much urban space may be freed up because much fewer parking space is needed when fleets of self-driving cars provide mobility services (which actually may increase the density of urban centers) and argue that the declining costs of mobility may increase the number of vehicles miles traveled.

On the other hand, they warn that the adoption of self-driving car technology could be hindered because the individual car owner does not profit sufficiently from the reduction in external costs of the technology (an argument that seems quite far-fetched) and fail to point out the obvious incompatibility of new regulations that would impose the “Irrebuttable presumption of driver control of vehicle” with fully autonomous mobility services. While the report warns about job losses in the transportation industry, they neither mention the risks for the auto industry nor their potential lack of incentives for deploying fully autonomous vehicles.

In the same vein, the sections on liability are mostly focused on the various alternatives of assigning liability to either the driver or the automotive manufacturer. The car’s owner and entity responsible for maintenance is not seen as another alternative. Neither are the additional concerns addressed that may arise when autonomous fleets are operated by mobility service providers.

The study is an excellent read and brings together many important aspects of autonomous vehicles. For those interested in the legal issues it also contains a good discussion of the theories of liability which are relevant in the United States. As their final conclusion, the authors recommend that policy makers let the technology evolve and abstain from premature regulation.

Driverless car white paper by KPMG: Why own a car?

When KPMG released their first white paper on self-driving cars in late 2012, we were surprised at how little thought they had given to the disruptive potential of fleets of driverless vehicles.They have corrected this now and a major headline and probably the guiding question of the report is: “Mobility on Demand: Why own a car?

This year’s report begins with the realization that the “momentum around self-driving vehicles is astonishing”. The authors acknowledge that the “industry is moving even faster than we predicted”. They look at the variety and number of autonomy-related news events during the preceding months. They conclude that “the technology is evolving at a rapid pace”. While the industry is definitely gaining momentum, the statement may be a bit on the optimistic side with respect to the technology: If we sort through all the announcements and public demonstrations of some cars driving in some state of quite limited autonomy, we can not see that many significant advances have occurred in the past 12 months.

They then look at the history of the first automotive revolution and proceed to report insights from focus groups. This is useful but yields few real surprises (even auto enthusiasts are willing to use self-driving cars; tech brands such as Google are a little more trusted even than premium auto brands with respect to the technology).

The most interesting section deals with a potential decrease in car ownership: “If half of all American families who currently own two or more cars were to give up one of their vehicles, how would that affect the automotive industry”. They point out that the ratio between fleet and retail sales could “change dramatically”. Mobility costs could decrease for the consumer and big data and dynamic pricing will be a key capability for autonomous mobility providers. They also hint at adverse consequences for mass transit systems.

It is great that the major consulting companies are beginning to realize how disruptive this technology will be (and it is nice that they are coming around to a view that we already had published in early 2010 (Autonomous cars – the next revolution looms).

If the momentum continues to increase – which is very likely – next year’s report will be very different. Then they may be at their best and provide a much more detailed look at business models, competitive space, impact, and strategic positioning for automotive companies and other industries. We will be looking forward to the next report!

French, Japanese prime ministers jump on the driverless bandwagon

World politicians are increasingly taking autonomous vehicles seriously. They start to recognize the importance of autonomous technology and the potential to profit from this innovation. French president Francois Hollande just presented a road map to revive French industry by promoting driverless cars and other technologies. Although it does not appear that France is prepared to fund driverless car development directly, they want to help bring about collaborations fostering this innovation. At this point, this may be what is needed most. There are many funds for this kind research available within the EU and venture capitalists are also discovering the high revenue potential in the area of self-driving cars. It is more important to clarify the legal ground rules for testing and operating driverless cars and making sure that these rules allow for fully autonomous operation. Because only fully autonomous operation will unlock the transformative potential of driverless technology and with it the investments needed to bring it about.

France and the other European countries should make clear that the they have the right and the intention to allow the operation of fully autonomous vehicles in their own territory as soon as they are certified to be extremely safe and as long as their operation is technically limited to a clearly specified region within the nation territory. Such a declaration would remove the doubts about the Vienna Convention standing in the way of automotive progress. Removing such legal uncertainties would open the floodgates for investors seeking to gain the pole position in this transformative technology.

France has good potential to accelerate this technology. The nation is open to novel technogies, has a great research base, has leading sensor manufacturers, and – even if the auto makers have invested much effort into autonomous technologies yet – has some well-positioned companies in the space. An example is the company Induct. It has positioned itself on one of the paths towards fully autonomous technology which is most likely to succeed economically: They don’t try to to build the perfect consumer car which can perform autonomously everywhere at every speed; they use autonomous technology to solve the last-mile transportation problem in  a limited and well known area and they initially focus on low-velocity operations which greatly reduces risk and therefore makes commercial success more likely. What they need are testing grounds, i.e. communities, airports, campus grounds where the vehicles can operate and be perfected.They have had problems finding testing grounds in Europe and have now found a more welcoming climate in Singapore – which is probably not what the Frence president had in mind…

Nevertheless, France should not go this path alone. It should at least partner with the other European countries to ensure that Europe remains at the forefront of this technology.

In Japan, prime minister Abe toured the streets around the parliament in Tokyo in three driverless cars (by Nissan, Toyota and Honda) in advance of the upcoming Tokyo Motor Show. Abe has made clear that he wants to advance “auto-pilot” technology as part of this economic policy.Japan has a long tradition of cooperation between government and industry to bring new technologies forward and is also a world leader in robotic technology – a key area that will both profit and play a crucial role in advancing driverless technology.

Overall, it is clear that autonomous technologies are starting to appear on the radar screen of world leaders. There are still too many misconceptions about this technology and the way it will come about. The views are still very auto-industry centric, focused on consumer cars, and fallacious ideas such as the ‘auto-pilot’ analogy still cloud their judgment. But behind all of this, world leaders are beginning to realize that a major innovation is in the making.

 

 

 

Italian low-cost driverless car prototype takes to the roads

On July 13 a low-cost driverless car developed by Italian computer vision expert Alberto Broggi navigated the roads of Parma, Italy in public traffic. The route included rural and urban roads, two freeway segments, traffic lights and roundabouts.

This is a major accomplishment because almost all current autonomous cars use an extremely expensive LIDAR sensor (which costs between 30000 and 70000 USD). Broggi’s car, in contrast, relies on an array of low-cost sensors including stereo cameras and several low-cost laser sensors. All sensors are hidden from view.

Driverless Car BRAiVE, Source: Vislab

The successful experiment (see full length video) highlights the rapid advances in computer vision. It is probably premature to conclude that autonomous cars will be able to rely mainly on computer vision – the weather situation in Parma was sunny (which has its own problems for computer vision) and cameras have difficulties at night. But the experiment is a strong indication that autonomous car technology is advancing rapidly and that different approaches than Google’s may lead to success.

Congratulations to Broggi and his team. We hope that they will be able to secure sufficient funding to take their work from the prototype stage to a full product soon. Besides the vision algorithms much work is needed to optimize the operational capabilities of the car for dealing with typical and rare traffic situations. This requires hundreds of thousands of kilometers of test driving and much fine-tuning that is beyond the capabilities of research institutes. The upcoming European Research Programm for Research and Innovation might be a good starting point for advancing this technology.

Source: Vislab

DARPA virtual robotics challenge: Lessons for driverless cars?

DARPA has just announced the winning teams of their virtual robotics challenge. Each team had to develop software to enable a very advanced humanoid robot to perform disaster-response tasks such as 1) walking to a standard utility vehicle and entering it, 2) driving the vehicle using steering wheel and pedals, 3)  walking on straight, uneven and obstacle-laden surfaces, 4) picking up a fire hose, connecting it and opening the valve. The winning teams will be provided with actual physical versions of the simulated robots and move on to the next level of the Darpa Robotics Challenge.

DARPA used the open source simulation environment Gazebo to create a virtual environment where the software of more than 100 competing teams could be tested. They have created a complete virtual world with a street, houses, obstacles etc. and developed a model of the robot which could then be placed into the virtual world and controlled by the team’s software. This approach has many advantages: Different scenarios can be tested, no physical damage can occur when the software does not behave as expected, the teams can use the simulation to optimize their algorithms etc.

A similar approach could be used to test driverless cars before they are released to the public. Official simulation environments would be needed with standard interfaces for the driverless car software. This would have to include standardized models which describe the behaviour of the car’s sensors (and translate the state of the simulation environment into sensor readings).

A  standard simulation environment for driverless cars would enable a testing body to verify that a software-based driverless car behaves as expected in many difficult cases. It would allow quantitative claims about the performance of driverless car software and could be used to compare different driverless car systems. Driverless car companies could use such test environments to prove that their software has been properly and carefully developed.

Of course test cases would have to be challenging and representative of the actual scenarios which a driverless car will encounter. This requires significant effort. It is likely over time the number of test scenarios which a driverless car software will have to pass will increase. In the event of driverless car accidents, the testing agency could rapidly analyze the causal chain for the accident and then build additional simulation test cases which the updated driverless car software would have to pass.

As we have argued in our white paper three years ago, it is extremely important to develop a public common simulation platform for driverless cars now!