TerralTech http://terraltech.com The power of sharing knowledge Mon, 13 May 2013 22:05:04 +0000 en-US hourly 1 http://wordpress.org/?v=3.5.1 How to install Solr on Ubuntu and auto start at boot http://terraltech.com/how-to-install-solr-on-ubuntu-and-auto-start-at-boot/ http://terraltech.com/how-to-install-solr-on-ubuntu-and-auto-start-at-boot/#comments Mon, 13 May 2013 22:02:40 +0000 techadmin http://terraltech.com/?p=1461 Solr

Solr (pronounced "solar") is an open source enterprise search platform from the Apache Lucene project. Its major features include full-text search, hit highlighting, faceted search, dynamic clustering, database integration, and rich document (e.g., Word, PDF) handling. Providing distributed search and index replication, Solr is highly scalable. Solr is the most popular enterprise search engine.
Installing Solr version 4.3.0 on Ubuntu 12.04 LTS

Requirement

  1. Java 1.6 or greater. running java -version at the command line should show version number starting with 1.6
  2. Solr release which you can find here.

Installation

Getting Tomcat6, install all dependencies with it apt-get install tomcat6 Checking Java version java -version Should get a result similar to this java version "1.6.0_27" OpenJDK Runtime Environment (IcedTea6 1.12.5) (6b27-1.12.5-0ubuntu0.12.04.1) OpenJDK 64-Bit Server VM (build 20.0-b12, mixed mode) Download the latest version of Solr and extract it wget http://apache.spinellicreations.com/lucene/solr/4.3.0/solr-4.3.0.tgz tar zxvf solr-4.3.0.tgz mv solr-4.3.0 /usr/local/solr-4.3.0 Testing Solr cd /usr/local/solr-4.3.0 java -jar start.jar Open your favorite web browser and open this URL http://:8983/solr/ Replace by the IP address of the Solr host You should get something looks like this [caption id="attachment_1465" align="alignnone" width="300"]Solr Dashboard Solr Dashboard[/caption]

Auto start Solr at boot

Follow my older post: Running Java applications as daemon on Linux See also: ]]> http://terraltech.com/how-to-install-solr-on-ubuntu-and-auto-start-at-boot/feed/ 0 Brief Installation of Ubuntu 13.04 Raring Ringtail Desktop edition http://terraltech.com/brief-installation-of-ubuntu-13-04-raring-ringtail-desktop-edition/ http://terraltech.com/brief-installation-of-ubuntu-13-04-raring-ringtail-desktop-edition/#comments Mon, 29 Apr 2013 15:02:17 +0000 techadmin http://terraltech.com/?p=1409 http://terraltech.com/brief-installation-of-ubuntu-13-04-raring-ringtail-desktop-edition/feed/ 0 Joining Ubuntu to MS Active Directory domain http://terraltech.com/joining-ubuntu-to-ms-active-directory-domain/ http://terraltech.com/joining-ubuntu-to-ms-active-directory-domain/#comments Thu, 25 Apr 2013 21:17:39 +0000 techadmin http://terraltech.com/?p=1373 Window

Likewise Open

Likewise Open provides a complete authentication solution allowing *nix systems to be fully integrated into Active Directory environments. Very easy to configure and it include GUI but in this post I don't explain how to setup the GUI.

Pre-configuration

Edit your resolv.conf and add the Microsoft DNS like this: vim /etc/resolve.conf nameserver 192.168.0.1 If you have static IP address you can have something like this in your /etc/network/interfaces file iface eth0 inet static address 192.168.0.3 netmask 255.255.255.0 gateway 192.168.0.1 dns-search DOMAIN.local dns-nameservers 192.168.0.55 But it's better if you have your DHCP server hand out the DNS nameserver address and search list.

Installation

apt-get update && apt-get install likewise-open

Joining a domain

With the command domainjoin-cli you can add the server to your AD domain domainjoin-cli join fqdn.of.the.domain Administrator It will prompt for the "Administrator" password followed with this message if it succeed SUCCESS You should reboot this system before attempting GUI logins as a domain user.

Verification and useful command

View the Status of the local and AD Authentication Providers lw-get-status List all known services and their status lwsm list Enumerate the users in Active Directory and view their members, GIDs, and SIDs lw-enum-users Listing Local and Domain users/group getent passwd getent group Print real and effective user and group IDs id DOMAIN\\user

Remote login to Ubuntu with AD user

Use one of these: ssh DOMAIN\\USER@HOSTNAME ssh 'DOMAIN\USER'@HOSTNAME ssh -l 'DOMAIN\USER' HOSTNAME

Allow Active Directory Domain Administrators to Administer Ubuntu

Edit the sudoers file visudo Add these lines %DOMAIN\\Administrators ALL=(ALL) ALL DOMAIN\\USERNAME ALL=(ALL) ALL Adding "%" at the beginning means we are referring to a Group, without it for user. With this we give sudo privileges to Active Directory users and groups. See also: ]]> http://terraltech.com/joining-ubuntu-to-ms-active-directory-domain/feed/ 0 How to setup Deployd on Ubuntu server http://terraltech.com/how-to-setup-deployd-on-ubuntu-server/ http://terraltech.com/how-to-setup-deployd-on-ubuntu-server/#comments Thu, 18 Apr 2013 12:34:49 +0000 techadmin http://terraltech.com/?p=1348 Deployd

Before we start

Pre-Requirements before we begin the installation: You must have mongod 2.0.x and node 0.8.x or higher installed and available in your PATH. I am going to use Ubuntu 10.04 for this tutorial

Installation

Updating the operating system apt-get update && apt-get upgrade

NodeJS

Node.js is a server-side software system designed for writing scalable Internet applications, notably web servers. Programs are written on the server side in JavaScript, using event-driven, asynchronous I/O to minimize overhead and maximize scalability.
Installation steps sudo apt-get install python-software-properties python g++ make sudo add-apt-repository ppa:chris-lea/node.js sudo apt-get update sudo apt-get install nodejs Verifying installation node -v v0.10.4 and npm -v 1.2.18 Check that you have the Path echo $NODE_PATH You should get something like this /usr/lib/nodejs:/usr/lib/node_modules:/usr/share/javascript:/usr/lib/node_modules/ Otherwise add this line to your ~/.bashrc or ~/.profile export NODE_PATH=$NODE_PATH:/usr/lib/node_modules/ Of course you need to logout/login to apply the changes!

MongoDB

MongoDB (from "humongous") is an open source document-oriented database system developed and supported by 10gen. It is part of the NoSQL family of database systems. Instead of storing data in tables as is done in a "classical" relational database, MongoDB stores structured data as JSON-like documents with dynamic schemas (MongoDB calls the format BSON), making the integration of data in certain types of applications easier and faster.
Import the 10gen public GPG Key sudo apt-key adv --keyserver keyserver.ubuntu.com --recv 7F0CEB10 Create a /etc/apt/sources.list.d/10gen.list file and include the following line for the 10gen repository deb http://downloads-distro.mongodb.org/repo/ubuntu-upstart dist 10gen Resynchronize the package index files from their sources apt-get update Install the packages sudo apt-get install mongodb-10gen Check the package's version dpkg -l | grep mongodb mongodb-10gen 2.4.2 An object/document-oriented database To make Deployd run continuously we're going to use Forever, a NodeJs module npm install forever -g This will daemonize your app and make sure it runs even if it crashes.

Deployd

Deployd is a tool that makes building APIs for web and mobile apps simple by providing important ready-made functionality out of the box that meet the demands of complex applications.
npm install deployd -g MangoDB conf file: /etc/mongodb.conf MongoDB instance will store its data files in the /var/lib/mongodb and its log files in /var/log/mongodb, and run using the mongodb user account. The dpd program should be available. Try dpd -V 0.6.10

Deployd app

Creating new user and database for our application in MongoDB mongo shell use admin db.addUser( { user: "deployd", pwd: "deployd", roles: [ "userAdminAnyDatabase" ] } ) use deployd db.addUser( { user: "deployd", pwd: "deployd", roles: [ "readWrite", "dbAdmin" ] } ) List all database show dbs admin 0.203125GB deployd 0.203125GB local 0.078125GB Choose where you're going to deploy your app and create your first app cd /var/www/ dpd create hello-world Go to the hello-world directory and create production.js file, follow instructions in http://docs.deployd.com/docs/server/run-script.md Modify your production.js file with the MongoDB information created above. And make sure your MongoDB is listening on the same port as configured in the production.js file. Issue the following command to see on what port is listening your program netstat -ntap Running your app forever start production.js Open this URL to see "Welcome to Deployd!" http://www.MyDomain.com:5000/ To get Deployed dashboard http://www.MyDomain.com:5000/dashboard You should be prompt for authentification key To get key, in "hello-world" directory type: dpd keygen and dpd showkey Copy the key into the browser to get access. Enjoy! See also: ]]> http://terraltech.com/how-to-setup-deployd-on-ubuntu-server/feed/ 0 Command line Games http://terraltech.com/command-line-games/ http://terraltech.com/command-line-games/#comments Wed, 17 Apr 2013 14:15:14 +0000 techadmin http://terraltech.com/?p=1306 Atari2600

Do you like video games? want to have fun on your break at work or just remembering the old time's sake... Play one of the oldest and mythic games in your favorite console, no need to install drivers or a super graphical card and for free! [box type="info"]Caution! use With moderation.[/box]

Petris

Console tetris game implementation on Python.

Installation

apt-get update && apt-get install petris Run the game and enjoy! petris [caption id="attachment_1310" align="alignnone" width="421"]Petris Petris[/caption]

nSnake

nSnake is a implementation of the classic snake game with textual interface. It is playable at command-line and uses the nCurses C library for graphics.

Installation

Download the latest version from : http://sourceforge.net/projects/nsnake/files/GNU-Linux/ wget http://sourceforge.net/projects/nsnake/files/GNU-Linux/nsnake-1.5.tar.gz tar zxvf nsnake-1.5.tar.gz cd nsnake-1.5 sudo apt-get install libncurses5-dev make sudo make install [highlight bgcolor="#000000" txtcolor="#2EFE2E"]*nsnake successfuly installed![/highlight] Now you can start palying! :) $ nsnake [caption id="attachment_1313" align="alignnone" width="567"]nSnake nSnake[/caption]

Pacman4consol

A pacman clone with custom level support!

Installation

wget https://sites.google.com/site/doctormike/pacman-1.2.tar.gz tar zxvf pacman-1.2.tar.gz cd pacman-1.2 make make install Let the party start ;) [caption id="attachment_1316" align="alignnone" width="207"]Pacman Pacman[/caption]]]> http://terraltech.com/command-line-games/feed/ 0 Securing your Rsyslog and LogAnalyzer http://terraltech.com/securing-your-rsyslog-and-loganalyzer/ http://terraltech.com/securing-your-rsyslog-and-loganalyzer/#comments Fri, 29 Mar 2013 10:26:33 +0000 techadmin http://terraltech.com/?p=1232 http://terraltech.com/securing-your-rsyslog-and-loganalyzer/feed/ 0 Using a private key to connect on your Linux servers http://terraltech.com/using-a-private-key-to-connect-on-your-linux-servers/ http://terraltech.com/using-a-private-key-to-connect-on-your-linux-servers/#comments Wed, 27 Mar 2013 13:25:12 +0000 techadmin http://terraltech.com/?p=1206 http://terraltech.com/using-a-private-key-to-connect-on-your-linux-servers/feed/ 0 Syslog server with Rsyslog and LogAnalyzer http://terraltech.com/syslog-server-with-rsyslog-and-loganalyzer/ http://terraltech.com/syslog-server-with-rsyslog-and-loganalyzer/#comments Wed, 27 Mar 2013 09:12:49 +0000 techadmin http://terraltech.com/?p=1166 Logs

Syslog is a standard for computer data logging. It separates the software that generates messages from the system that stores them and the software that reports and analyzes them.

Installing Rsyslog server

Installing Rsyslog from repository

Install PGP Key into your apt system sudo apt-key adv --recv-keys --keyserver keyserver.ubuntu.com AEF0CF8E Edit your sources.list and add these lines sudo vim /etc/apt/sources.list # Adiscon repository deb http://ubuntu.adiscon.com/v7-devel precise/ deb-src http://ubuntu.adiscon.com/v7-devel precise/ Update your apt cache and install rsyslog sudo apt-get update && sudo apt-get upgrade sudo apt-get install rsyslog

Installing some dependencies

apt-get install rsyslog rsyslog-mysql unzip zip binutils cpp fetchmail flex gcc libc6-dev libpcre3 libpopt-dev lynx m4 make ncftp nmap openssl perl perl-modules zlib1g-dev autoconf automake1.9 libtool bison autotools-dev g++ mysql-server mysql-client libmysqlclient15-dev apache2 apache2-doc apache2-mpm-prefork apache2-utils libexpat1 ssl-cert libapache2-mod-php5 php5 php5-common php5-curl php5-dev php5-gd php5-idn php-pear php5-imagick php5-imap php5-json php5-mcrypt php5-memcache php5-mhash php5-ming php5-mysql php5-ps php5-pspell php5-recode php5-snmp php5-sqlite php5-tidy php5-xmlrpc php5-xsl Enter the password for MySQL when the installation ask you for it. Check that Apache and MySQL are listening on ports netstat -tapn Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 127.0.0.1:3306 0.0.0.0:* LISTEN 25240/mysqld tcp 0 0 0.0.0.0::80 0.0.0.0:* LISTEN 25844/apache2 Next we configure the rsyslog server to listen on TCP port 514: sudo vim /etc/rsyslog.conf $ModLoad MySQL *.* >127.0.0.1,<SyslogDatabase>,<rsyslogUserName>,<rsyslogUserPassword> Default values: <rsyslogUserName>: rsyslog <SyslogDatabase>: Syslog , created by default during the installation process of the dependencies <rsyslogUserPassword>: Password inserted during the installation process of the dependencies Comment out these lines in the rsyslog.conf # provides TCP syslog reception $ModLoad imtcp $InputTCPServerRun 514 Restarting the rsyslog service /etc/init.d/rsyslog restart Checking that rsyslog is listening on TCP port 514 netstat -ntap Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 0 127.0.0.1:3306 0.0.0.0:* LISTEN 25240/mysqld tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 25844/apache2 tcp 0 0 0.0.0.0:514 0.0.0.0:* LISTEN 27177/rsyslogd

Installing the Log Analyzer

First download the most recent build from here: http://loganalyzer.adiscon.com/downloads cd /usr/local/src wget http://download.adiscon.com/loganalyzer/loganalyzer-3.6.3.tar.gz Extracting the file tar zxvf loganalyzer-3.6.3.tar.gz Move loganalyzer-x.x.x/src/ folder to you webserver root folder mv loganalyzer-3.6.3/src/* /var/www/ Changing user rights to Apache chown www-data:www-data -Rf /var/www/* cp loganalyzer-3.6.3/contrib/* /var/www/ chmod +x /var/www/configure.sh /var/www/secure.sh ./configure.sh This will create a blank config.php, and will also set write access to everyone to it. Now open in your favorite browser http://<LogAnalyzerIP>/install.php Go through the simple steps configuration "Next" till the configuration steps is finished Don't forget to remove the installation file when finished rm -f /var/www/install.php Troubleshoot: If you get this error message: Syslog file is not readable, read access may be denied Add use www-data to adm group sudo vim /etc/group adm:x:4:www-data Reload Apache service apache2 reload

Configuring Rsyslog to send data to Log Analyzer server

All you need to do is editing rsyslog.conf file vim /etc/rsyslog.conf Add the following lines # provides TCP syslog reception #$ModLoad imtcp #$InputTCPServerRun 514 $WorkDirectory /rsyslog/work # default location for work (spool) files $ActionQueueType LinkedList # use asynchronous processing $ActionQueueFileName srvrfwd # set file name, also enables disk mode $ActionResumeRetryCount -1 # infinite retries on insert failure $ActionQueueSaveOnShutdown on # save in-memory data if rsyslog shuts down *.* @@<RsyslogIPaddress> /etc/init.d/rsyslog restart Checking that rsyslog is communicating with the server netstat -tapn Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name tcp 0 5612 192.168.0.10:55793 192.168.0.20:514 ESTABLISHED 11592/rsyslogd This is what you should get if your setup is successful [caption id="attachment_1190" align="aligncenter" width="1498"]Rsyslog reports with LogAnalyzer Rsyslog reports with LogAnalyzer[/caption] [caption id="attachment_1191" align="aligncenter" width="1491"]Rsyslog statistics with LogAnalyzer Rsyslog statistics with LogAnalyzer[/caption] See Also: ]]> http://terraltech.com/syslog-server-with-rsyslog-and-loganalyzer/feed/ 0 Enabling SSL in Monit and M/Monit http://terraltech.com/enabling-ssl-in-monit-and-mmonit/ http://terraltech.com/enabling-ssl-in-monit-and-mmonit/#comments Thu, 21 Mar 2013 12:33:04 +0000 techadmin http://terraltech.com/?p=1162 http://terraltech.com/enabling-ssl-in-monit-and-mmonit/feed/ 0 How to install M/Monit – Monit http://terraltech.com/how-to-install-mmonit-monit/ http://terraltech.com/how-to-install-mmonit-monit/#comments Thu, 21 Mar 2013 10:19:09 +0000 techadmin http://terraltech.com/?p=1036 monitoring servers with monit

monit is a free, open source process supervision tool for Unix and Linux. With monit, system status can be viewed directly from the command line, or via the native HTTP(S) web server. M/Monit, a purchased software distributed by the creators of monit (Tildeslash LTD) expands upon the capabilities of monit, providing multi-host monitoring and analysis from within one web interface.

What monit can do

It can start a process if it is stopped, restart a process if it is not responding or stop a process if it is using too much resources. You can use Monit to monitor files, directories, filesystems

Installing monit

Installing monit on Ubuntu

Installing as a package from the distribution repository sudo apt-get install monit

Installing monit on Centos

First we need to install some prerequisite yum -y install openssl* gcc yum install pam-devel yum install openssl-devel Download the latest version from here http://mmonit.com/monit/ cd /usr/src/ wget http://mmonit.com/monit/dist/monit-5.5.tar.gz Extract tar file tar zxvf monit-5.5.tar.gz Compiling from source cd monit-5.5/ ./configure make && make install Monit control file: cp /path/to/monit-5.5/monitrc ~/.monitrc chmod 0700 .monitrc

Installing M/Monit "simple"

This part of the tutorial was written for Ubuntu 12.04, but the configuration should apply to other distributions with little changes as well. Download the latest version from here http://mmonit.com/download/ wget http://mmonit.com/dist/mmonit-2.4-linux-x64.tar.gz extract tar file and start mmonit tar zxvf mmonit-2.4-linux-x64.tar.gz mv mmonit-2.4/ /usr/local/mmonit/ cd /usr/local/mmonit/ ./bin/mmonit Open URL http://ServerIP:8080/ Default Login: admin Default Password: swordfish

Installing M/Monit "advanced"

Installing mysql

sudo apt-get install mysql-server php5-mysql Create mmonit database: mysqladmin create mmonit -u root -p Create the mmonit user and grant access to the mmonit database: mysql> GRANT ALL ON mmonit.* to mmonit@localhost identified by 'MmonitPassword'; Create the schema: mysql -u mmonit mmonit -p < /usr/local/mmonit/db/mmonit-schema.mysql

Adding new user

adduser mmonit Changing mmonit owner and group sudo chown -R mmonit:mmonit /usr/local/mmonit

Configure M/Monit

Edit configuration file mmonit/conf/server.xml and replace the SQLite <Realm> element with <Realm url="mysql://mmonit:MmonitPassword@127.0.0.1:3306/mmonit" minConnections="5" maxConnections="30" reapConnections="300" /> Adjust username, password, host and port number in the connection URL as required.

Automatic startup M/Monit

Register M/Monit as Monit service in the Monit configuration file (/etc/monit/monitrc): check process mmonit with pidfile /usr/local/mmonit/logs/mmonit.pid start program = "/usr/local/mmonit/bin/mmonit -d" as uid MmonitUID and gid MmonitGID stop program = "/usr/local/mmonit/bin/mmonit stop" as uid MmonitUID and gid MmonitGID Replace MmonitUID and MmonitGID by the respective ID. Reload monit monit reload Open URL http://ServerIP:8080/ Default Login: admin Default Password: swordfish

Configuration of Monit to communicate with M/Monit

mmonit To setup communication between Monit and M/Monit, add the following statements to the top of each Monit control file, monitrc: sudo vim /etc/monit/monitrc set mmonit http://<user>:<password>@<M/Monit-host>:<port>/collector set httpd port 2812 and use address <monit-host> allow localhost allow <M/Monit-host> allow username:password Default <user>:<password> is monit:monit To change these, connect to your WebUI > Admin > Users And edit the default user monit's password, or add a new one. See also: ]]> http://terraltech.com/how-to-install-mmonit-monit/feed/ 0