Enhancing GIS with Augmented Reality

Addressing with Augmented RealityThe other day at work we visited with our police records office to learn more about their reporting software. One of the issues that came up in our discussion was inputting the “address” of incidents. The software they use relies on either point addresses or address ranges along a centerline – both common methods of address locating in a GIS. The problem with using these methods for locating typical incidents handled by the police is that incidents are not always tied to a specific address. Instead, particularly for traffic stops, police put down block numbers of a specific street on their reports. And many times, just finding the block number in the field can be a challenge. Houses numbers might not be legible or present, or in our case, addresses in one block can range from 300 to 1500 then back down to 400.

Initially they discussed using the nearest address that can be seen, but the problem with this is the incident is then tied to that address when it really isn’t. It might have been a speeding ticket that was stopped right outside the address, but that incident really doesn’t have anything to do with that specific property. The other problem is the nearest address that can be found might be quite a distance away. One other solution discussed was to just use 100, 200, etc. as the address. Normally this works to at least place the incident in the correct block, although it might be a problem if you have addressing like ours where the address ranges go up and down in one block. The other problem with using a number like 100 is that along our borders, we might not have jurisdiction over the “even” side of the street. So putting in 100 codes the call to the other jurisdiction. To get around this, the records clerks have to put in 101 so it codes to the correct agency.

We wondered why the software company, that makes this software for this purpose, doesn’t realize the needs of their clients and offer an alternative method of inputting addresses. If the records staff had a choice of inputting incidents by block and jurisdiction, the point could be placed in the correct location. This would at least take care of the problem in the office of coding the call. But what about in the field? One idea we thought of was using augmented reality to place virtual address numbers along the block. Police or other emergency personnel could view these by simply wearing glasses that pick up AR objects. This seems like a great use for AR technology to help our police staff have better and faster access to addresses when generating reports. And can you imagine how helpful this would be to an ambulance driver who is on an emergency call to a specific address? We could make the numbers as big as possible and place them along the curb so they stand out for the driver. And perhaps there could be some method of tying the emergency call to the AR object so it flashes red or some other color.

Share

Adding Augmented Reality to Your Zoning Ordinance

Augmented reality holds promise and opportunity for the public works industry. With the development of this technology through efforts like the Smart Vidente Project and the recent release of development tools by Layar, we are moving closer to actual implementation on the job. And over the next few months, I plan to try to set up some layers for work using the Layar service. So I was discussing this with another engineer at work and trying to come up with some ideas to try out. We  thought about setting up some virtual notifications programmed to pop up when we approach certain properties in the city. These notifications could alert us to drainage issues, special structures in the area, and other information in which we would be interested. But as we imagined this future of virtual objects left waiting to be discovered, the other engineer came up with a brilliant question. He wondered if anyone could set out virtual objects like this, what would prevent the world from becoming a virtual junkyard.

DragonHe had an excellent point. Right now the technology is so new, we don’t yet have this problem. If I walk through out city today with the Layar app on my smart phone, there is a good chance I will see no virtual objects. But once the technology becomes ubiquitous, we could walk through our cities looking for something with our augmented reality app and find ourselves bombarded by virtual junk. This virtual junk would also detract from augmented reality uses for wayfinding and utility location. And what could be worse is that people could leave virtual junk on our private property. Maybe someone gets upset with someone else and decides to leave a virtual sign with some not-so-nice wording on that person’s lawn. So there will probably come a day when there will need to be some regulation defining where virtual objects can be placed. But once you start considering this and how it fits into our current system of governance and regulations, it becomes quite an intriguing discussion. Local government regulates and permits placement of objects in the right of way, so should this permitting be extended to virtual objects placed in the right of way? And who should have the authority to regulate what is placed on private property?

Developing the framework for regulating augmented reality in public and private spaces will take some thoughtful consideration and time. But setting this up now will make it that much easier when we get the first call from one of our citizens complaining because someone put a virtual, 20-foot pink dragon breathing fire on their property.

Share

Monitoring the Pothole Buzz

Potholes in an asphalt roadway.Seems like over the last year, several sites have popped up offering people a chance to create a "to do" list for their local public works department. From logging potholes to traffic problems and graffiti, websites like FixMyStreet, SeeClickFix, City Sourced, PublicStuff, Lagan311, and many others are encouraging citizens to upload problems onto maps. Three years ago when FixMyStreet was the only site like this out there, it seemed like a great idea. Particularly when SeeClickFix opened up for those of us in the U.S. But now there are many services like this, and citizens using the sites are expecting that we will see their problem regardless of where it is posted. However, one city cannot keep track of all sites offering these services and then spend time monitoring each one on a daily basis.

Fortunately cities like San Francisco have taken the lead in providing us a solution. Earlier this year, they launched their own Open311 program designed to allow these services to interact with San Francisco's data. The other key to implementing this interaction has been the development of an Open311 standard organized by OpenPlans – a non-profit organization working to support open government and citizen engagement. The group's Open311 project "provides open communication with public services and local government." What this means is that all services, including our work order systems, will have a common language for transferring information. And if our work order system has been well designed, it will be able to reach out and grab all the issues posted on these sites. It should also offer us the opportunity to only pull the issues located within our jurisdictional boundaries.

So where does this all leave us today? Some might be thinking it isn't something they really have to worry about. But based on what I have seen happening, you will eventually have to address it. The sites are not going away – they are only increasing in number. And once citizens find these sites, elected officials are not far behind. If one of their constituents has a concern that has not been taken care of, you know you will be getting a call. 

If you are fortunate enough to already have a work order program that has adopted this open standard, you should just need an upgrade. If you don't have a work order system or CRM (customer relationship management) program, but you are in the market for one, just make sure the program provides this service. Finally, if you can't afford to upgrade or purchase, you could try visiting the most popular sites being used by your citizens and grabbing or subscribing to the feed of issues. Most offer the opportunity to "follow a zip code" or "create a watch area." Then whenever anything gets posted, the issue is sent to your email. The Open311 Wiki offers a list of current services here:

http://wiki.open311.org/Main_Page#311_Services

Share

Using Unity3D to Simulate a City

Most of my exploration of virtual worlds for engineering has been in Second Life and OpenSim. However, this year I have been looking more at Unity3D. Engineers are conservative and seem to dismiss virtual worlds like Second Life and OpenSim. Even though these programs are 3D modeling tools, they don't resemble nor do they use the typical CAD tools engineers are used to working with. Because Unity3D works well with these CAD tools and better resembles modeling programs, I suspect it will find greater acceptance by AEC groups.

As an example of what can be done with Unity3D, I show below a crude example of importing DEM files into Unity3D. While the process is fairly easy, I still have some issues with the elevations looking too exaggerated, and there is an area that does not have contours. I also need to figure out how to apply the aerial images to the ground. So I still have a lot of work to do to refine this, but I thought it was pretty cool to be able to import contours and see the flat land transform immediately to reflect the topology of my city. I put some water in the model to indicate the river which helps to highlight the dam and islands. But I have yet to add any buildings, trees, or other features.

 Fox River Valley in Geneva, Ill.

 

Screenshot from Unity3D of Fox Valley River Valley through Geneva, Ill.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Another cool aspect of Unity3D is it can be embedded in a browser. Below is the static representation of what I created showing a view looking north through the river valley. Eventually I can add the capability for someone to travel through this model of my city with an avatar.

[WP_UnityObject src="http://www.publicworksgroup.com/images/stories/test1.unity3d" /]

Share

Virtual Worlds: The Next Level of Government

Crowd by davidChief on FlickrIn small numbers, people can usually self-govern themselves. But as the number of people in a group grows, better control is needed. So history has shown anytime a large number of people start hanging out in a particular place, a government structure is formed. In our world today, we have nations which then have further divisions of government down to local or neighborhood levels. And while most of these levels of government are considered public, a small number are privately held and yet still considered a governing body by upper levels of government. So applying this to virtual worlds, have these digital places evolved to the point that another type of government level needs to be formed?

I would expect many people, particularly those who have not yet ventured into a virtual space, would scoff at the idea of creating a new type of government subdivision for computer-generated worlds. During my first few years of hanging out in places like Second Life, I had not considered the need for governance. But during those years, I observed many parallels between the growth of Second Life and the development of a city. And recently, the discussions surrounding the struggles of Linden Lab to address the needs of Second Life "residents," have me more closely analyzing the governance idea.

Although I don't think Linden Lab started Second Life with the intention of creating another governmental entity, it is interesting to see elements of local governance in the early days of the grid. Philip, the creator of Second Life, was labeled Governor Linden, and the users were called residents. Experiments in zoning took place on at least one of the first sims. And the subdivision and sale of land and payment of tier (tax) for that land is an emulation of land ownership in the U.S.

Second Life has gone through phases regarding these issues: tier is still paid and users are still residents, zoning has been created on a much larger scale with the division of adult, mature, and PG spaces, Philip is no longer referred to as Governor although public land is still held by Governor Linden. And as the Lab struggled to determine their policies in these areas, similarities between the problems faced by Linden Lab and those we face as city officials grew. Today there are demands by residents for better functioning infrastructure and platforms through which to voice opinions. Businesses are continually pushing for economic tools, incentives, regulations, and opportunities. All issues faced every day by those of us working in local government.

Server Farm photo from Sugree Phatanapherom on FlickrPost-Victorian water mains by Lars Plougmann on FlickrAt this point, Second Life has evolved to where the primary differences I see between its digital space and the physical space are in the type of infrastructure and the international population. And even the infrastructure, while different, still has many similarities to the operation and maintenance of infrastructure in the physical world because it is part of that physical world. Cities have water mains and roads; Second Life has computers and code.

So, the most challenging difference I can see is the International aspect of the Second Life population; governments in the physical world are based on geographic boundaries. Cyberspace has no geographic location in the physical world. Anyone with a computer and an Internet connection can access places like Second Life. So if a digital space became a governmental entity, into which governmental structure would it fit and in which country? And whose laws govern each person's behavior in that world?

If I travel to another country, I follow that country's rules and yet I am still bound by some of the laws in my own country. If I visit a digital space, I follow the terms of use for that world no matter where it is based in the world. Yet, because I am in the U.S., the U.S. government could argue I need to also follow laws of this country because I am using federally regulated bandwidth to access that world. So some might question, if there are already terms of use for visiting virtual worlds, why aren't those rules good enough?

Terms of use seem to work well for regulating behavior in digital spaces when user freedoms and choices are limited. For example I don't see Blizzard dealing with the same issues facing Linden Lab. Both companies have created virtual worlds, but the MMORPG offers a more structured space with well-defined and limited abilities for its users. While in Second Life, the users have many more freedoms and choices. I compare the MMORPG to a museum I would visit in a city like Chicago. My museum visit is structured and defined by the rules and environment created by that museum. While my behavior and actions in Chicago are only bound by the laws of the city, state, and U.S. government.

City Hall by Editor B - Bart Everson - on Flickr

Even with the growing similarities between digital and physical places, governance in virtual worlds is probably not on the immediate horizon. People are still just getting used to the idea of a digital world. But this concept of a virtual world functioning as an actual place could help companies like Linden Lab better understand what they have created. And as the Lab is finding out, running local government is not easy. But it is an age-old practice with thousands of years of models and literature available for guidance. Maybe what Linden Lab needs now to sort out all their issues is someone with a background in public administration.

Share

A Brave New Grid – Post 2: The Virtual Plan

Ontario Build in Second LifeIn the first post of this series, I explained my decision about moving my efforts related to building government/public works/engineering sites in virtual worlds from Second Life to OpenSim. And I invited anyone interested to read along or visit as I make this move. From here on out, I will continue to write about the thoughts and processes an agency follows to create and operate a virtual site:

Just like any good story, this one starts at the beginning—back before an agency even sets a digital foot into the virtual arena. Today many agencies might not have even heard of virtual worlds while a few others have heard of them but not yet thought about leveraging this tool to deliver value to citizens. But, eventually someone, either staff or citizens, will bring up the possibility of using virtual worlds to enhance service delivery. At that point the agency must decide whether to ignore the suggestion or investigate virtual solutions. If the agency decides to go forward, the first step is to create a virtual plan. Here are some ideas about how an agency would go about developing their plan:


Developing a Virtual Plan

Create a Project Team

Assuming an agency decides to venture forth, my first suggestion is to form a project team. Team members should be comfortable using online technology, possess good assessment skills and articulation, and have a comprehensive understanding of the agency’s general structure, goals, mission, and strategy. It would also be helpful to include a few community stakeholders on the team such as members of the agency's leadership, residents, business owners, and leaders in community organizations.

Set Goals and Strategies

The team’s first order of business is to determine what the agency would want to accomplish with the use of virtual worlds. These goals should align with the overall goals and strategies for the organization. This is also a good time to think about the targeted audience—who will visit this virtual space? Below are some suggestions for both virtual spaces and related audiences:

  • Engage local citizens.
  • Attract potential tourists and deliver visitor information.
  • Recruit potential employees, citizens, businesses.
  • Plan proposed development and receive input from citizens and developers.
  • Present 3D representations of code and ordinance requirements so residents/business owners can more easily understand and access regulations.
  • Train employees.

 

Decide on Software and Hosting

In order to develop, access, and maintain these virtual spaces, the agency will need to acquire a software package and possibly a hosting plan. Although virtual worlds may seem like a brand new tool, they function in a manner similar to a traditional Website. By this I mean that the agency will use development software to create the world and the content within. Then others will use a software program to access the agency’s site. And just like a Website, the digital space will require a computer on which to reside. Therefore, the agency will need to determine if their virtual space will be served out from their own computers or through a host.

Here is a list of the more common solutions currently in use for enterprise and government purposes:

Virtual world development can be complex so it’s critical the team identify features and requirements for each software package from cost to performance to ease of use and support. This is where tables and charts come in handy. Here are some suggestions to consider including in the analysis:

Developer    Purchase and Annual Cost    User base    Technical Requirements    Security     Scalability    Backup Capabilities    

Database Requirements and Compatibility     Storage Requirements

The team can assess each program by assigning a ranking for each feature and requirement. For example, if a low number is chosen to indicate a more beneficial choice, then the purchase price could be categorized by the following numbering system:

1 – $0 to $999

2 – $1,000 to $4,999

3 – $5,000 to $9,999

4 – $10,000 and greater

 

Technical requirements could be simplified into the following categories for ranking:

1 – Basic computer system costing less than $1,000

2 – Average computer system costing between $1,000 and $2,000

3 – Moderate computer system costing between $2,000 and $3,000

4 – Loaded computer system costing more than $3,000

 

Categories and rankings should be chosen to best describe each agency’s assessment of needs and capabilities. After assigning a rank to each category and adding up all the points for each feature and requirement, the team can rank the software packages.

 

Visit Virtual Worlds

Next the team should download the virtual tools and spend time in virtual worlds created by each software solution under consideration. It’s helpful to document observations and first impressions because this can offer insight into how the agency’s user base will experience their first visit. Team members might also visit existing government sites in virtual worlds. Usually people managing these sites are more than willing to share their experiences with others.

 

Establish a Virtual Site Policy

Visiting virtual spaces can also help the team formulate a virtual space policy for staff and visitors. For employees this policy can address their appearance, communication procedures and guidance, hours of work, and other issues related to representing the agency in a virtual space. For visitors the policy will cover how they should conduct themselves, what they will be allowed to do in the space, how they can dress, if they can access all or just a portion of the space, and consequences for not following the rules.

 

Develop Virtual Site Designs

After spending time in each world and interviewing managers of existing sites, the team can begin formulating a more specific idea of what they will want to create for their own agency. A framework for each can be designed to meet the agency’s goals and to fit within the constraints and structure of each software package under consideration.

Based on the type of build desired and the goals the agency wants to achieve, the team will develop alternative designs for the site. At this point, designs do not have to be detailed. Simply showing a square labeled “Central Business District” can indicate a design that includes a 3D representation of the agency’s downtown. The most important step is to make sure the designs include elements that allow the agency to achieve their stated goals.

Greenies from Second Life

Choose the Development Team

The team must next consider whether the agency can build the virtual site with in-house staff or if a consultant must be hired to perform the work. If the work can be down by agency employees, the team should identify members of a potential development group and their corresponding skills. In making this decision, the team needs to keep in mind not only staff abilities, but the availability of content for each virtual solution. Some worlds, like Second Life, offer extensive ready-made content and building tools that allow most people the ability to create an acceptable space. However, other software solutions require more extensive software skills and offer little to no content.

If a consultant will be hired, the team might want to research potential companies experienced in the creation of virtual worlds. It is important to identify which software tool each company has experience with and visit sites they have created. Interviewing past clients can offer insight into whether the company has the desired experience and understanding to handle a government agency’s requests and needs. Also check to see if the company has retained the employees who created past builds or if you will be working with a new and less experienced staff. Another important consideration is to check with past clients to make sure the company met deadlines and came within budget.

Establish Operations and Management Procedure

Once the site is established, there will be management needs. So the plan should include a section addressing how the site will be staffed and managed during the first few months and then for the long term. Decisions to be made in this step could include if the agency is going to staff the site with existing full or part-time employees or if new employees will be hired. Virtual sites are open 24/7 so the agency also needs to decide on what hours staff will be available at the site. If the agency intends to host events, the hours and staffing for these along with a proposed list of events should be included.London Re-creation in Second Life

Agencies also prefer to assess operations on a regular basis. If the site is created, this assessment needs to become part of the overall operation and management plan of the agency. With this process in place, the project team can be utilized on a regular basis to review the site on an annually and submit a report indicating how well the site is meeting the goals and objectives laid out in the plan. This procedure can also allow for amendments and changes to be made through an established process.

 

Compile the Plan

At this point, the team can begin compiling the virtual plan. The plan should include the following elements:

 

  • General proposal and description of what a virtual site is intended to accomplish

 

  • Specific goals, objectives, and strategies and how they fit into the overall agency plan including references to targeted audience/user base

     

  • Listing and discussion of available software solutions with a summary of the team’s findings (a more detailed report can be included in an appendix)

     

  • Proposed virtual site policy

     

  • Concept designs

     

  • Suggested development team

     

  • Timetable for execution of the virtual plan

     

  • Marketing and/or advertising plan including intended channels to be used

     

  • Short term and long term management of the site including staffing proposal

     

  • Assessment procedure

     

  • Budget for software purchase, development, and management

 

Once a draft of the plan is complete, it is advisable for the agency to host a few public meetings to get input from residents, businesses, and other community stakeholders. Comments should be discussed, and if appropriate, incorporated into the plan. Minutes and comments from all public hearings should be added to the plan as an appendix. The agency's attorney also needs to review the plan at this point and offer any needed revisions.

When the report has been finalized, the team can present the plan to the agency's board or council for formal approval.


 

 

Related reading and resources:

"Virtual Spaces: Enabling Immersive Collaborative Enterprise, Part 1: Introduction to the opportunities and technologies" IBM article

Share