PySpark on python3 and Debian

Share

Install openjdk 8 To install openjdk 8 on debian 10, follow steps mentioned at https://linuxize.com/post/install-java-on-debian-10/pyspark does not works well with newer versions of Java, so stick with openjdk or oracle java 8. Install PySpark Next install pyspark using python pip, I prefer python3 so installation goes with pip3 PySpark brings along required hadoop components Basic […]

Write your first REST API using Python Flask

Share

Since years programming concepts have been evolving with new ideas and improvements. Idea of API, Application Programming Interface, came out to build integration between applications/software/platforms. It has simplified integration between totally different applications and platforms. In early days (even now), APIs were in form of client APIs. Software developers/organizations offer client software component which is […]

Write your first python module

Share

If you are planning to build a mid to enterprise size project/product then you should consider object oriented coding practice. This benefits in many ways. For eg, your code remains tidy and you can reuse components of your code in other projects. Module is essentially a collection of several classes and class functions. These functions […]

Python filter function

Share

This is an interesting feature in python. Suppose you have a list of items and you want to apply quick filters such as “greater than x”, “less than x”, “above average”, “below average” on list items, then filter() method makes it quite handy. Typical syntax of filter function is like filter(some_func_name, list_of_items) You can also […]