Mapping a SIF Message to a SOAP Message

The following diagram establishes a mapping between a SIF message and a SOAP message.

Integrity Schools is Launched

Foremost, I apologize for the lack of new content lately. Many good things will hopefully result from the effort going into my "day job." We have officially launched Integrity Schools as a separate company to focus exclusively on SIF and business intelligence for schools. The full press release follows:

The Relationship Between SOA and Data Models

This is a brief but enlightening read on the relationship between SOA and Data Models.

http://weblog.infoworld.com/realworldsoa/archives/2008/10/advocating_the.html

Building Modular XML Schemas

This is a good article hosted at IBM on building modular schemas. It includes practical tips that will help you avoid the pitfalls of creating schemas that are too "quick and dirty."

Race Code Spreadsheet

A transition is underway that requires schools and states to report data about race and ethnicity to the Federal government differently than they have in the past. For those who may be interested I have placed a copy of the race code spreadsheet that I developed here. The sheet is a very simple lookup tool that enables mapping the name of a specific race to codes defined by the NCES and the Office of Management and Budget. You may also find a link to a handout that contains all 900+ race codes on (2) pages here. Thanks to Barbara Andrepont, Judi Barnett, Laurie Collins and all others who helped with this.

Instructional Services Objects

The SIF Association has been placing a needed emphasis on the technology's use within teaching and learning. As of version 2.2 of the SIF Implementation Specification, there are a total of (8) objects that directly address core needs of teaching and learning processes. The Instructional Services Task Force (ISTF) is the group within SIF that is moving this work forward.

The diagram below of the ISTF objects contains more detail than the general Data Model ERD on which I continue to work. Almost all of the elements and attributes of the Instructional Services objects are present in this diagram, with the exception of a few that I omitted for the sake of clarity. Here is the link to the ISTF objects within the Implementation Specification.

One other item worth noting is that I am hoping to use these objects, specifically the LearningStandardItem object, on a client project to rigorously document their learning standards for use within multiple future projects. This is a good example where the SIF Data Model has significant intrinsic value, even without a specific need to "move" data using the Infrastructure.

Lastly, the SIF Association is holding a developer's camp for teaching and learning in Portland on Thursday, September 25 and Friday, September 26. For more information, see this page on the SIF website.

Using the National Education Data Model

At the NCES STATS-DC 2008 conference I co-presented with Vince Paredes on the National Education Data Model. My portion of the presentation focused on how we have started using the National Education Data Model in our data warehousing work. This is the link to a PDF version of the paper that is the basis for my presentation content. It is hosted on a Google Site because, to my knowledge, Blogger does not support PDF attachments. The unofficial site for the National Education Data Model is hosted at http://nces.sifinfo.org/datamodel.

Reflecting on STATS-DC 2008

Over the past two days I have spent much time preparing for talks, presenting, thinking, and talking with the nation's pK-20 data leaders. LEA's, SEA's, the U.S. Department of Education, and many commercial enterprises are represented here, each with ideas about the sharing of data and information. The concept of connectedness entered my mind many times, seeming to be the gravity-binder that keeps these ideas loosely interacting like masses at great distances. I was fortunate to be invited to participate in four talks: 1) Race/Ethnicity: It's all in the codes, or is it? 2) Implementation Forum: District Level Models 3) Using the Education Data Model in Longitudinal Data Systems and 4) The Evolution of the SIF Standard--Where We Are and Where We Are Going.
For the first presentation, I presented with Judi Barnett (CSIU), Barbara Andrepont (ESP Solutions Group), and Laurie Collins (SIF Association) on the work that the SIF Association has done to decipher the collection, sharing, and reporting of race and ethnicity. The crux of the issue is that states must transition to a new model for reporting race and ethnicity as separate concepts by 2010. My conclusion from all of the background work done is that we need to encourage storing race and ethnicity data at the maximum possible resolution.
The second presentation focused on trends experienced by a panel of SIF Association members. Consensus among this group, which is not generally achieved without much deliberation, was that the market is incredibly strong for SIF (and other interoperability solutions) and that all external factors are positive.
Although some would consider data models an extremely dry topic, the third presentation was actually a lot of fun for me. For the past several weeks I have been working with Vince Paredes, the SIF Association's Data Model Architect, on using the National Education Data Model in our work. We essentially conducted a gap analysis for a data mart that we are designing for a client against the National Education Data Model. I will post the paper developed for this presentation in a separate blog entry. Vince introduced the National Data Model and its concepts, and I followed up by going through our gap analysis step-by-step.
The final session punctuating my participative responsibilities in the conference focused on the Oklahoma Department of Education's SIF Profile proof of concept. A Profile is an extension of the SIF Implementation Specification that will be used, initially by SEA's, to fine tune the SIF Data Model and interoperability business rules to meet specific needs.
Through the acts of preparing, presenting, and communicating with colleagues at this conference, I feel as if I have had my eyes opened in new ways to the accomplishments of the present, and to huge potential on the horizon.

SIF_Header Diagram

SIF_Header is present in every SIF Message. Below is a diagram of SIF_Header that contains its elements, their corresponding data types, and explanations drawn primarily from the specification. An XML example from the specification is also shown with a particular explanation regarding the use of SIF_DestinationId.
(I have decided to post this and future diagrams as GIF's because they tend to render more cleanly than PNG's.)

New Reports Show SIF Object Usage Across Certified Applications

The Certification Register at http://certification.sifinfo.org is the authoritative source of information about the capabilities of SIF Certified Applications and Agents. The site has recently been enhanced in two ways.
It is now possible to view a Data Model report that details and summarizes the use of SIF Data Objects by Certified Agents. This enables you to get a sense of which objects are most widely supported, and in what ways.
Located underneath this information (on the same page) is a matrix that represents the intersection of two applications. Hovering over a cell reveals the ways that the two systems may interoperate, at a Data Object level.
In combination, these reports provide end-users and developers with much information about how SIF is being used, and how it may be used. This is the direct link to the Data Model report.

STATS-DC 2008

Next week I will be attending and presenting at the STATS-DC 2008 data conference in Bethesda, MD. Both presentations that I am a part of are on the SIF track of the conference. The National Education Data Model will be the focus of one of the presentations. My role will be to discuss how we have used it in one of our projects at work. The second presentation will cover what the SIF Association has done (and is doing) about collecting and reporting race and ethnicity data. If you are coming to the conference, please attend these sessions!

SIF Message Objects

SIF's Infrastructure defines a set of Message Objects (synonyms in other vocabularies include stickers and envelopes) that underpin its asynchronous data exchange capabilities. SIF Agents wrap commands and Data Objects in appropriate Message Objects to accomplish interoperability functions. Zone Integration Servers lightly parse the Message Objects to control the routing of data from Agent to Agent. SIF Data Objects are the subject of the Entity Relationship Diagram previously discussed here. To reprise: Data Objects are the implementation of SIF's data model for interoperability (students, staff, enrollment, etc.). Data Objects also happen to be the essential unit of data exchange in SIF. The following diagram illustrates an overview of SIF Message Objects (click the image to view it standalone).

SIF and Open Source

Outside observers of SIF often make the comment that the SIF Association (SIFA) should implement an Open Source Zone Integration Server, or an Open Source Agent development tool set. I generally respond to these comments by analogizing SIF with other standards bodies, like the W3C. Similarly to the W3C, the primary output of SIFA is its standards.

Take as an example the W3C's XHTML specification. Under the auspices of the W3C, member organizations collaborate to draft, test, refine, and release the detailed technical definition of the XHTML technology. Acting as individual organizations, these members implement software that leverage, for commercial and non-commercial purposes, the specification developed by the standards body. It would be, however, very unlikely for the W3C to actually develop a web browser or web server that implemented XHTML in software.

Many standards bodies, like SIFA and the W3C, publish their works openly. Any organization or individual, including Open Source projects, may benefit by deciphering, adopting, and implementing the standards, regardless of membership status, and without paying licensing fees to the standards body. Other standards bodies, in contrast, choose to sell their work using fee-based licenses. Although SIFA is not an Open Source initiative, the open publication of its standards is certainly an enabler for industrious Open Source developers.

SIFA, its members, and the wider world of educational technology would greatly benefit from additional documentation to fill the void between the SIF specifications and their implementation in software. To that end, one of the purposes of this blog is to share some of my practical experience with SIF. I would like to take this opportunity to encourage SIFA to work towards providing more developer-centric documentation, including code samples, as part of its work. Since SIF's core technologies (XML and HTTP) are ubiquitous, basic code samples could be developed for every modern programming language and platform. The results of such work would be clarity for a wider audience of developers in the school market, the demystification of SIF, and, ultimately, wider adoption.

I would also encourage individuals and groups developing Open Source SIF software to become involved in the Association. Involvement will greatly accelerate your efforts in building good software that solves schools’ interoperability and data management needs.

The "Moveable Feast"

The "Moveable Feast" is an Illinois technology conference that gathers school personnel from across the state to share information about a diverse set of education technologies. It is the longest running education technology training program in Illinois. The "Feast" started over 10 years ago with the objective of providing relevant training to teachers, technologists, and administrators. Approximately 10,000 people have benefited from the program during its run. "Feast" collaborators include the University of Illinois College of Education, District 87 and several other Illinois school districts, and corporate sponsors like Microsoft and Discovery Education.

The "Geek Edition" of the "Feast" was held this week in Bloomington. Sessions covered topics ranging from content management, to software development, to SIF (of course!), and business intelligence. Another "Geek Edition" of the "Feast" will be held in Belleville in July. Following is a sampling of the sessions: Schools Interoperability Framework*, Moodle I & II, Reporting and Business Intelligence*, Web Design & Scripting with PHP/AJAX, Beginning and Advanced Virtualization, Data Warehousing*, Joomla, and SharePoint

* Indicates one of my sessions

My thanks to Jim Peterson and Brian Adams for inviting Integrity to participate in the "Feast!"

Gradebook Objects Added to SIF ERD

The SIF Data Model Entity Relationship Diagram has been updated to include the Grade Book Data Objects (thanks to Andy Elmhorst for the suggestion).

Perspectives on SOA

Joe McKendrick wrote a brief but thought provoking post at ZDNet regarding different perspectives on SOA. The title is "Looking at SOA through ESB-colored glasses."

NCES Releases "The Condition of Education 2008"

This is a re-post of an IES Newsflash from ed.gov:

The National Center for Education Statistics within the Institute of Education Sciences has released "The Condition of Education 2008," a congressionally mandated report that provides an annual portrait of education in the United States. The 43 indicators included in this year's report cover all aspects of education, from early childhood through postsecondary education and from student achievement to school environment and resources. Among the report's findings:

* This year, public school enrollment is expected to approach about 50 million students. Total public school enrollment is projected to set new records each year from 2008 to 2017, at which time it is expected to reach 54.1 million.

* Minority students make up 43 percent of the public school enrollment overall and 48 percent in the South and 55 percent in the West.

* In 2005–06, about a third of Black students and a third of Hispanic students attended high-poverty schools compared with 4 percent of White students.

* Average reading scores of 4th- and 8th-graders were higher in 2007 than in 1992.

* Average mathematics scores increased 27 points for 4th-graders and 19 points for 8th-graders between 1990 and 2007.

* Among public high school students in the class of 2005, about three-fourths graduated on time.

* Since 1970, women's undergraduate enrollment has increased over three times as fast as men's. Currently, women make up 57 percent of undergraduate enrollment.

* In 2006, young adults with a bachelor's degree earned about $11,000 more than those with an associate’s degree, about $16,000 more than those who had completed high school, and more than twice as much than those who did not earn a high school diploma.

The full text of "The Condition of Education 2008," along with related data tables and indicators from previous years, can be viewed at http://nces.ed.gov/programs/coe.

XML Apologies

Kurt Cagle has written a great post at XML.com regarding the strengths and weaknesses of everyone's favorite declarative "meta-language." Here is an excerpt:

I think a part of the reason that people continue to insist on trying to encode things in XML that don’t belong there is that they have been trained that there is one and only one paradigm to data modeling - the Object Oriented Programming model.

When Good XML Goes Bad

XML.com recently published an article titled "Bad XML." It is a good read for those of you that are interested in markup design. In SIF I think we do a fairly good job of not creating "Bad XML," but there is definitely room for improvement. Here is the link to the article.

SIF ERD Updated with Assessments

The SIF Data Model Entity Relationship Diagram has been updated to include the Assessment Data Objects. Again, please feel free to nominate what you would like to prioritize for inclusion in the diagram as I continue to update it.