Monday, March 23, 2009

Openness

Obama takes another step toward open government with this advice to federal agencies to release records and information to the public unless it will result in "forseeable harm," although I think we all know that it's pretty hard to forsee all possible harm. At least we're shifting the burden back to government having to show forseeable harm instead of the burden on the FOIA-request-making public to have to show need.

Tuesday, March 17, 2009

Signing statements

I was going to write about signing statements last week when Obama issued one, but then I saw that Melissa had posted on this topic, so I just commented on her blog with my thoughts. Now, the NY Times editors are weighing in. Melissa was definitely correct in saying that people will be watching Obama to see if his actions match his words. The NY Times editors say "...the speed with which he issued this statement, and the number of provisions he objected to, raise concerns that he may use these statements too aggressively. It will bear watching."

Indeed.

OMG - the Government Gets Proactive

For once, the Feds have identified a potential problem BEFORE it gets out of hand and are proposing an amelioration. Here's hoping they move at industry speed and not government speed, or even this radial proactivity will end up reactive.

See "Improving Grants.gov" from Benton

Saturday, March 14, 2009

Federal Website Assessment

OK, so this is not the first time I have assessed a website. This is actually a topic I have taught to undergrads. And I completed a usability test of a non-federal but still government website last year in Chuck’s Evaluation class (with Aaron). So, some of this week’s reading are familiar territory. But, I have never really thought about web assessment from an information policy perspective.

I know what works and what doesn’t when it comes to web design, based on usability readings and my own background in printing and newspaper layout (bet y’all didn’t know that). But knowing what works and what doesn’t has very little to do with actual implementation. I am forever arguing with my undergrads about the difference between making a website for yourself, where you can use any design you like, and making a website at the behest of a client. With a client, you HAVE to do what THEY want. All you can do is offer suggestions, provide options, and try to make the strongest possible case for a website that follows usability and accessibility guidelines (i.e. the U.S. Department of Health and Human Services usability guide on Usability.gov and Jakob Nielsen’s recommendations on UseIt.com).

[Side note on functionality: No matter what you have to give in to regarding usability, accessibility and aesthetics, all features of any system should always FUNCTION. For goodness sake, what’s the point of non-functioning features?]

In class, my students usually choose a for-profit business or a FSU department for their web redesign project. In the fall, though, one group chose the FAFSA website, which I agree is pretty awful. [FAFSA is the Free Application for Federal Student Aid in case any of you are blessed not to need student aid and don’t know about the FAFSA.] Anyway, the group made changes to the website that would put it in violation of federal laws. For example, they didn’t know they have to include a privacy statement and a link for FOIA requests.

When you are designing a web site for a Federal agency or department, the first step should be identification of all information policies and regulations that relate to web site assessment (McClure, Sprehe, & Eschenfelder, 2000). At the very least, start with the Office of Management and Budget (OMB) Policies for Federal Websites (2004). Obviously, not all Federal web sites are designed this way since so many violate the Section 508 accessibility regulations (West, 2008), let alone usability issues.

But failure to follow existing guidelines is not the only information policy issue related to web assessment. The scope, implementation, and enforcement of existing policies are also critical (Eschenfelder, Beachboard, McClure, & Wyman, 1997).

Yes, there is Section 508, but is it current? Is it relevant with current assistive technologies? I am guessing no, but someone needs to actually verify my guess.

Also, we know the potential value of E-Government to open government, cost savings, etc. (Freed, 2009), but do we know exactly how much return on investment (ROI) the Federal government is getting by utilizing electronic technologies? And do we know how much ROI they COULD be getting, e.g. are they getting less ROI than they possibly could get? Nielsen explains how much ROI governments could get by increasing usability, something that suggests that E-Government services are not getting the overall ROI they could get. Nielsen says that on average, websites increase desired metrics by 135% following a usability redesign (2003), although this figure has declined some (to 83% in 2008). He also explains the ROI that government agencies get from usability, especially when they engage in e-commerce (2007), something Freed tells us they do fairly well (2009).

Meanwhile, we know from the American Customer Satisfaction Index that Americans seem satisfied with E-Government services (Freed, 2009), but the satisfaction level of 74.1 out of 100. That’s a C. Hardly what I’d call satisfaction, more like complacency. There is a BIG difference between satisfaction and success. Aaron and I found that out last year when we did a usability test on MyFlorida.com. The five test participants said they were satisfied with certain aspects of MyFlorida.com that they did not use successfully. For example, there were tasks that the testers “completed” because they found an answer, but it was the WRONG answer. Yet, they were SATISFIED. This is satisficing, and that is a far cry from success.

And there’s another issue with Americans’ satisfaction with E-Government – the comparison between that and traditional government service. Apparently, satisfaction with E-Government is higher than satisfaction with traditional government. But who is reporting their satisfaction? You know that voluntary surveys are full of methodological holes so how reliable are the ACSI data (Grob’s argument for good enough evaluations notwithstanding)? Consider the fact that last year they reported a three-year low for E-Government satisfaction but not it’s an all-time high (Freed, 2008, 2009). How weird does that seem? And there’s the possibility that Americans have higher expectations of traditional government than E-Government so even equal service quality could get a higher satisfaction rating for E-Government than traditional government. Going back to the usability test Aaron and I did last year, most of our testers indicated they started with REALLY LOW expectations of MyFlorida.com. So even though they were “satisfied” with the services, that’s based on a low starting point!

I obviously have a lot to say on this topic. Good thing I am presenting this week!

References

Eschenfelder, K. R., Beachboard, J. C., McClure, C. R., & Wyman, S. K. (1997). Assessing U.S. federal government websites. Government Information Quarterly, 14(2), 173-189. Retrieved March 29, 2008, from Science Direct database.

Freed, L. (2009). American customer satisfaction index: E-Government satisfaction index. Ann Arbor, MI: ForSee Results. Retrieved March 12, 2009, from http://www.theacsi.org/images/stories/images/govsatscores/0109q4.pdf

Freed, L. (2008). American customer satisfaction index e-government satisfaction index [Electronic resource]. Available from http://www.theacsi.org/index.php?option=com_content&task=view&id=178&Itemid=181

Grob, G. F. (2003). A truly useful bat is one found in the hands of a slugger. American Journal of Evaluation, 24(4), 499-505. Retrieved March 12, 2009, from Science Direct database.

McClure, C. R., Sprehe, J. T., & Eschenfelder, K. (2000). Performance measures for Federal agency websites: Final report. Tallahassee, FL: Florida State University, School of Information Studies, Information Use Management & Policy Institute.

Nielsen, J. (2008, January 22). Usability ROI declining, but still strong. Alertbox [Electronic resource]. Retrieved March 29, 2008, from http://www.useit.com/alertbox/roi.html

Nielsen, J. (2007, February 12). Do government agencies and non-profits get ROI from usability? Alertbox [Electronic resource]. Retrieved March 29, 2008, from http://www.useit.com/alertbox/government-nonprofit.html

Nielsen, J. (2003, August 25). Usability 101: introduction to usability. Alertbox [Electronic resource]. Retrieved March 29, 2008, from http://www.useit.com/alertbox/20030825.html

Nielsen, J. (2003, January 7). Return on investment for usability. Alertbox [Electronic resource]. Retrieved March 29, 2008, from http://www.useit.com/alertbox/roi-first-study.html

Office of Management and Budget. (2004). Memorandum for the heads of executive departments and agencies: Policies for Federal agency public websites. Washington, DC: Office of Management and Budget. Retrieved March 12, 2009, from http://www.whitehouse.gov/omb/memoranda/fy2005/m05-04.pdf

U.S. Department of Health and Human Services. (2006). Research-based web design and usability guidelines [Electronic version]. Washington, DC: U.S. Department of Health and Human Services. Retrieved March 12, 2009, from http://www.usability.gov/pdfs/guidelines.html#1

U.S. Department of Health and Human Services. (n.d.). Usability.gov [Electronic resource]. Washington, DC: U.S. Department of Health and Human Services. Retrieved March 12, 2009, from http://www.usability.gov

West, D. M. (2008). State and federal electronic government in the United States, 2008. Washington, DC: Brookings Institution.

Friday, March 13, 2009

Dangers of Google Docs

1. I hope I don't get banned from Google for posting this article.
2. I stopped using Google Docs a while ago, but not for security and privacy reasons. Just because Google Docs deleted all your MS Word formatting which is hugely annoying.
3. At least Google is honest about their security breaches.

Check it out: "Google Privacy Blunder Shares Your Docs Without Permission"

Monday, March 9, 2009

Lieberman also wants public access to CRS briefs

So Patrice is not alone in lamenting that more CRS issue briefs need to be made public. Lieberman agrees. I do too, but I hope there isn't a secret brief hiding in there about Nicole and my topic for class, or if there is, that it remains secret until we're done. Otherwise, what are we going to do?

Saturday, March 7, 2009

Obama names new Chief Information Officer

So Obama has named a CIO - Vivek Kundra. Here's the scoop -

From the NY Times.
Kundra speaks.
Lynn Sweet calls the new CIO Obama's E-Gov czar.
You know you've made it when you get a Wikipedia entry.