Archive for the ‘Mathematica’ Category

Social Network Analysis (Mathematica 9)

Thursday, November 29th, 2012

Social Network Analysis (Mathematica 9)

From the webpage:

Drawing on Mathematica‘s strong graph and network capabilities, Mathematica 9 introduces a complete and rich set of state-of-the art social network analysis functions. Access to social networks from a variety of sources, including directly from social media sites, and high level functions for community detection, cohesive groups, centrality, and similarity measures make performing network analysis tasks easier and more flexible than ever before.

Too many features on networks to list.

I now have one item on my Christmas wish list. ;-)

How about you?

I first saw this in a tweet by Julian Bilcke.

Journal of Statistical Software

Tuesday, June 26th, 2012

Journal of Statistical Software

From the homepage:

Established in 1996, the Journal of Statistical Software publishes articles, book reviews, code snippets, and software reviews on the subject of statistical software and algorithms. The contents are freely available on-line. For both articles and code snippets the source code is published along with the paper.

Statistical software is the key link between statistical methods and their application in practice. Software that makes this link is the province of the journal, and may be realized as, for instance, tools for large scale computing, database technology, desktop computing, distributed systems, the World Wide Web, reproducible research, archiving and documentation, and embedded systems.

We attempt to present research that demonstrates the joint evolution of computational and statistical methods and techniques. Implementations can use languages such as C, C++, S, Fortran, Java, PHP, Python and Ruby or environments such as Mathematica, MATLAB, R, S-PLUS, SAS, Stata, and XLISP-STAT.

There are currently 518 articles, 34 code snippets, 104 book reviews, 6 software reviews, and 13 special volumes in our archives. These can be browsed or searched. You can also subscribe for notification of new articles.

Running down resources used in Wordcloud of the Arizona et al. v. United States opinion when I encountered this wonderful site.

I have only skimmed the surface for an article or two in particular so can’t begin to describe the breadth of material you will find here.

I am sure I will be returning time and time again to this site. Suggest if you are interested in statistical manipulation of data that you do the same.

Wolfram Plays In Streets of Shakespeare’s London

Monday, April 23rd, 2012

I should have been glad to read: To Compute or Not to Compute—Wolfram|Alpha Analyzes Shakespeare’s Plays. Promoting Shakespeare has to be a first for Wolfram.

But the post reports word counts, unique words, and similar measures as master strokes of engineering, all things familiar since SNOBOL and before. And then makes this “bold” suggestion:

Asking Wolfram|Alpha for information about specific characters is where things really begin to get interesting. We took the dialog from each play and organized them into dialog timelines that show when each character talks within a specific play. For example, if you look at the dialog timeline of Julius Caesar, you’ll notice that Brutus and Cassius have steady dialog throughout the whole play, but Caesar’s dialog stops about halfway through. I wonder why that is?

That sort of analysis was old hat in the 1980′s.

Wolfram needs to catch up on the history of literary and linguistic computing rather than repeating it.

The back issues of Computational Linguistics or Literary and Linguistic Computing should help in that regard. To say nothing of Shakespeare, Computers, and the Mystery of Authorship and similar works.

On digital humanities projects in general, see: Digital Humanities Spotlight: 7 Important Digitization Projects by Maria Popova, for a small sample.

Sage

Thursday, November 10th, 2011

Sage

Kirk Lowery mentioned Sage to me and with mathematics being fundamental to IR, it seemed like a good resource to mention. Either for research, using one of the course books or satisfying yourself that algorithms operate as advertised.

You don’t have to take someone’s word on algorithms. Use a small enough test case that you will recognize the effects of the algorithm. Or test it against another algorithm said to give similar results.

I saw a sad presentation years ago when a result was described as significant because the manual for the statistics package used said it was significant. Don’t let that be you, either in front of a client or in a presentation to peers.

From the website:

Sage is a free open-source mathematics software system licensed under the GPL. It combines the power of many existing open-source packages into a common Python-based interface.

Mission: Creating a viable free open source alternative to Magma, Maple, Mathematica and Matlab.

From the feature tour:

Sage is built out of nearly 100 open-source packages and features a unified interface. Sage can be used to study elementary and advanced, pure and applied mathematics. This includes a huge range of mathematics, including basic algebra, calculus, elementary to very advanced number theory, cryptography, numerical computation, commutative algebra, group theory, combinatorics, graph theory, exact linear algebra and much more. It combines various software packages and seamlessly integrates their functionality into a common experience. It is well-suited for education and research.

The user interface is a notebook in a web browser or the command line. Using the notebook, Sage connects either locally to your own Sage installation or to a Sage server on the network. Inside the Sage notebook you can create embedded graphics, beautifully typeset mathematical expressions, add and delete input, and share your work across the network.

The following showcase presents some of Sage’s capabilities, screenshots and gives you an overall impression of what Sage is. The examples show the lines of code in Sage on the left side, accompanied by an explanation on the right. They only show the very basic concepts of how Sage works. Please refer to the documentation material for more detailed explanations or visit the library to see Sage in action.

In all fairness to Mathematica, the hobbyist version is only $295 for Mathematica 8. With versions for Windows (XP/Vista/7) Max OS X (Intel) and Linux. There is a reason why people want to be like…some other software. Mathematica has data mining capabilities and a host of other features. I am contemplating a copy of Mathematica as a Christmas present for myself.

Do note that all of the Fortune 50 companies use Mathematica. The hobbyist version allows you to add an important skill set that is relevant to a select clientele. Not to mention various government agencies, etc.

Should a job come along that requires it, I can simply upgrade to a professional license. Why? Well, I expect people to pay my invoices when I submit them. Why shouldn’t I pay for software I use on the jobs that result in those invoices?

Don’t cut corners on software. Same goes for the quality of jobs. It will show. If you don’t know, don’t lie, say you don’t know but will find out. Clients will find simple honesty quite refreshing. (I can’t promise that result for you but it has been the result for me over a variety of professions.)