via Green Building Elements | From brick and mortar shops to city planning, we cover sustainable trends in construction, renovation, and more.. This definitely sounds promising, anyone have experience running a similar setup? A small company, SpinRay Energy, has announced the production of a new UL listed, grid-tied solar power system that couldn’t be easier to […]
Posts by
IoT Day 2: Cloud Services for Energy Monitoring
Energy monitoring isn’t only about knowing what’s happening right now, but also understanding what happened historically. Often that includes knowing not just what was happening but also when and why. Enter cloud services for energy monitoring. They range from simple charts and graphs to predicting your usage over time – essentially storing, analysing and enriching your […]
Web console for Kafka messaging system
Running Kafka for a streaming collection service can feel somewhat opaque at times, this is why I was thrilled to find the Kafka Web Console project on Github yesterday. This Scala application can be easily downloaded and installed with a couple steps. An included web server can then be launched to serve it up quickly. Here’s […]
Drinking from the (data) Firehose of Terror
Between classic business transactions and social interactions and machine-generated observations, the digital data tap has been turned on and it will never be turned off. The flow of data is everlasting. Which is why you see a lot of things in the loop around real time frameworks and streaming frameworks. – Mike Hoskins, CTO Actian […]
Kafka Consumer – Simple Python Script and Tips
[UPDATE: Check out the Kafka Web Console that allows you to manage topics and see traffic going through your topics – all in a browser!] When you’re pushing data into a Kafka topic, it’s always helpful to monitor the traffic using a simple Kafka consumer script. Here’s a simple script I’ve been using that […]
Neo4j Cypher Query for Graph Density Analysis
Graph analysis is all about finding relationships. In this post I show how to compute graph density (a ratio of how well connected relationships in a graph are) using a Cypher query with Neo4j. This is a follow up to the earlier post: SPARQL Query for Graph Density Analysis. Installing Neo4j Graph Database In this example we launch Neo4j and […]
Code snippet: SPARQL Query Graph Density
Code snippet: SPARQL Query Graph Density I’m testing out sharing SPARQL code snippets using Github Gist features. I’ll be adding more as I work through more graph-specific examples using SPARQLverse, but here is my first one: View the code on Gist. Ideally we’d have a common landing place for building up a library of these […]
Graph relations in Neo4j – simple load example
In preparation for a post about doing graph analytics in Neo4j (paralleling SPARQLverse from this earlier post), I had to learn to load text/CSV data into Neo. This post just shows the steps I took to load nodes and then establish edges/relationships in the database. My head hurt trying to find a simple example of […]
Graph analytics – the new super power
Graph analytics – is it just hype or is it technology that has come of age? Mike Hoskins, CTO of Actian sums it up well in this article from InfoWorld: “One area where graph analytics particularly earns its stripes is in data discovery. While most of the discussion around big data has centered on how to […]
SPARQL Query for Graph Density Analysis
I’ve been spending a lot of time this past year running queries against the open source SPARQLverse graph analytic engine. It’s amazing how simple some queries can look and yet how much work is being done behind the scenes. My current project requires building up a set of query examples that allow typical kinds of graph/network […]
Kafka Topic Clearing after Producing Messages
[UPDATE: Check out the Kafka Web Console to more easily administer your Kafka topics] This week I’ve been working with the Kafka messaging system in a project. Basic C# Methods for Kafka Producer To publish to Kafka I built a C# app that uses the Kafka4n libraries – it doesn’t get much simpler than this:
1 2 3 4 |
using Kafka.Client; Connector connector = new Connector(serverAddress, serverPort); connector.Produce(correlationId, hostName, timeOut, topicName, partitionId, message); |
I was […]
Data Sharing Saved My Life – or How an Insurer Reduced My Healthcare Cl...
It’s not every day that you receive snail mail with life-changing information in it, but when it does come, it can come from the unlikeliest sources. A year ago, when doing a simple change of health insurance vendors, I had to give the requisite blood sample. I knew the drill… nurse comes to the house, takes blood, […]
Running Gephi graph vizualization on OSX Mavericks (10.9.5)
Having trouble launching latest Gephi on OSX? I’m running Mavericks but I’m sure this will help others who have upgraded or who are still running older versions of OSX. From command line, use the jdkhome parameter when launching Gephi and point it to the system Java 1.6 install:
1 2 |
$ cd /Applications/Gephi.app/Contents/MacOS $ ./Gephi --jdkhome /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/ |
Analytics Dashboard – Kibana 3 – a few short quick tips
After you’ve loaded log files into elasticsearch you can start to visualize them using the Kibana web app and build your own dashboard. While using Kibana for a week or so, I found it tricky to find the docs or tutorials to get me up to speed quickly with some of the more advanced/hidden features. In […]
From zero to HDFS in 60 min.
(Okay, so you can be up and running quicker if you have a better internet connection than me.) Want to get your hands dirty with Hadoop related technologies but don’t have time to waste? I’ve spent way too much time trying to get HBase, for example, running on my Macbook with Brew and wish I had […]