Learning BI

 Terraform Written Notes.  I have used this notes to clear my Terraform Associate Certification 

 Script to get Disabled users in IICS   This script user Informatica Cloud APIs to get user details and pulls disabled and locked users even if SAML is integrated. You need to replace username, password, send email, receiver email and SMPT server so that it generated disabled users list for that org in the same path from where you are running the script.  import requests import json import sys import datetime import smtplib, ssl from email.mime.base import MIMEBase from email.mime.text import MIMEText from email.mime.multipart import MIMEMultipart filename= "userslist.txt" username = "username" password = "Password" current_timestamp = datetime.datetime.utcnow().strftime( '%Y-%m-%d %H:%M:%S' ) with open (filename, 'w' ) as f: f.write(current_timestamp+ ' \n ' ) username = username password = password url = "https://dm-us.informaticacloud.com/saas/public/core/v3/login" payload = json.dumps({ "username" : user...

  1. How will you describe Airflow? Apache Airflow is referred to an open-source platform that is used for workflow management. This one is a data transformation pipeline Extract, Transform, Load (ETL) workflow orchestration tool. It initiated its operations back in October 2014 at Airbnb. At that time, it offered a solution to manage the increasingly complicated workflows of a company. This Airflow tool allowed them to programmatically write, schedule and regulate the workflows through an inbuilt  Airflow user interface.  2. What are the problems resolved by Airflow? Some of the issues and problems resolved by Airflow include: Maintaining an audit trail of every completed task Scalable in nature Creating and maintaining a relationship between tasks with ease Comes with a UI that can track and monitor the execution of the workflow and more. 3. What are some of the features of Apache Airflow? Some of the features of Apache Airflow include: It helps schedule all the jobs an...

 As we  Tableau is considered as one of the best BI and Data Visualization tools and has bundle of unique features that makes it more popular, lets learn few of them .  I will  be explaining them in detail in further posts. Please add any features in the comments that I have missed adding here.  Tableau features :  API Access Control Active Directory Integration Activity Dashboard Ad hoc Analysis Ad hoc Query Ad hoc Reporting Categorization Collaboration Tools Content Library Custom Fields Customizable Reporting Dashboard Creation Data filtering, import/export, mapping, storage management, visualization. Database Integration Drag & Drop Interface Email Integration Email Notifications Filtered Views Gantt Charts Geographic Maps Geolocation Interactive Content Metadata Management Multiple Projects Offline Access Permission Management, Role-Based Permissions Real-Time Analytics, Real-Time Data Self Service Portal Task Management Third-Party Integration Tre...

  You need to have a Snowflake Data platform for it . If not please create one as below: You can start by signing up for a free trial on Snowflake: Sign up for a free trial by following link https://signup.snowflake.com/ and completing the sign-up form. Select the Enterprise edition, choose a cloud provider and region, and agree to the terms of service. Click GET STARTED. After submitting the sign-up form, you should receive an email asking you to activate your account. Click the link in the email and a new tab will open up where you’ll create your username and password. Complete the form and click Get started. Congrats! Your workspace is ready for some data.  Now to load sample data use below queries. #creating Warehouse, Database and schemas create warehouse transforming; create database raw; create database analytics; create schema raw.jaffle_shop; create schema raw.stripe; #creating customer table and loading Data create table raw.jaffle_shop.customers  ( id integer, ...

               Most of the Companies adhere to password policy of 60-90 days . Tableau workbooks, Datasources and Flows needs to have the DB password updated adhering to the policy.               I want to make an executable that makes easy to change the passwords. Here is the new Executable that helps to change the passwords in tableau objects. import tableauserverclient as TSC import argparse ,os, configparser, re from argparse import ArgumentParser, ArgumentDefaultsHelpFormatter import logging import datetime CONFIGURATION_FILE="passwordconfig.txt" #configuration file name and path.  #Copy the config file from the below  #logmodule def create_logger(log_id):     logger = logging.getLogger(log_id)     logger.setLevel(logging.DEBUG)     fh = logging.FileHandler(filename="passwordchangelog.txt") #log filename and its path     fh.setLevel(logging.DEB...

  To Enable Einstein Discovery on Tableau Server  We need to enable Extension on Tableau Server . There are few Prerequisites and requirements to enable it. The whole process is described below.  CORS A prerequisite for this is configuring CORS in Salesforce Org. Here is the process to enable CORS Sign in to your Salesforce.com developer account, click your user name in the upper-right, and then select Setup . In the left navigation column, search for "cors" and select CORS . In CORS , in the Allowed Origins List section, click New . In CORS Allowed Origin List Edit , enter the URL of your Tableau server, beginning with "https://". For more information about the URL pattern, see the Salesforce developer documentation: https://developer.salesforce.com/docs/atlas.en-us.chatterapi.meta/chatterapi/extend_code_cors.htm Click Save . Reference : https://help.tableau.com/current/server/en-us/config_cors_sfdc.htm OAUTH If you are integrating Einstein Discovery extensions w...