Tech bytes
Login and parse ASP.NET sites with Python
I am using web scraping on several sites to get information like prices from e-commerce sites and meter readings, balance amount etc from my apartment service provider portal. This is fairly simple to do in python using “requests” and “beautifulsoup” modules. Recently, my apartment service provider revamped their website in ASP.NET. I thought it was […]
Automated bulk command execution on SSH enabled hosts and devices
In the lockdown period, during pandemic, there is nothing much to do over weekend 😏. Was just thinking of writing ✍️ something, something useful…. then came up with an idea to address a common problem that many sysadmins and netadmins come across. At times, we want to run set of commands on many devices, hosts […]
IoT switch using relay operated by micropython based NodeMCU
IoT is gaining market rapidly. In recent years, many appliance, automobile manufactures have started adding “connected” features in their product line. Most basic IoT implementation you can think of is, switching on|off an appliance over internet. Let us see how this works and how you can build a IoT switch under 7 USD. You need […]
Multi topic IoT subscriber model
In a typical IoT model, you have many IoT sensors publishing data to IoT broker. You may want to collect data from all these IoT nodes in a database for visualization and further analytics. I have couple of IoT nodes installed in two houses in two different cities. And I collect data from all IoT […]
Air quality monitor using GP2Y1010AU0F sensor on micropython based NodeMCU
I had purchased GP2Y1010AU0F sensor about 6 months back. Finally, found time to hook it with NodeMCU controller. Firstly, let me list things you need. NodeMCU (ESP8266) controller (~300₹). GP2Y1010AU0F dust/smoke sensor(~450₹). 150k ohm resistor. 220 µF capacitor. breadboard with some connecting wires. Here is the connection schema of circuit. Since solution is based on […]
Transmit weather stats from DHT22 using MQTT on micropython
In my previous article about DHT22 sensor, I had used arduino based programming to collect and transmit weather stats over MQTT. But that time I was wondering, how can I make it flexible by having WiFi, sensor and MQTT parameters configurable. Now, with micropython, I can prepare a simple json config file having all parameters […]
Publish IoT messages from micropython based client
Micropython is quite capable firmware to build prototypes and do experiments. Paired with ESP8266 micro controller board, it builds a perfect IoT client, which can be further interfaced with variety of sensors, motors, relays etc. Fundamental of IoT is data collection from sensors and connected IoT nodes. You can also establish machine to machine communication […]
micropython – an exciting firmware for microcontrollers
Arduino based controller boards have been all time favorite for developing prototypes and small projects.Arduino uses C++ style of coding. For many new starters it may not be the best programming language with start with. A promising alternate to Arduino is micropython firmware. This is available for variety of boards.In this article, I will cover […]
CSV logs ingestion to elasticsearch using Fluentd
You can push streaming CSV logs/data into Elasticsearch using Fluentd with very simple config. Consider following CSV data of Cars Make, Model, Year and Price. Now, to take it down into elasticsearch, prepare following config in fluentd td-agent.conf file Restart fluentd daemon and you will notice data in file starts going into elasticsearch. To visualize […]
High performance python based SNMP poller
In my last post, I wrote a basic SNMP poller using python easysnmp module. To make it more practical and industry ready I have further enriched it with following: Read SNMPv2 and SNMPv3 devices from CSV file. Based on the field count in device record use SNMPv2 or SNMPv3 module. Poll thousands of devices by […]