extra technology_ education

Bash Shell Scripting for AutoSys Users

Course Description

Much of the underlying strength of Linux derives from its large collection of text-based tools and utilities, in conjunction with a powerful command and scripting language called the shell. Taken together, this toolset provides a high-level and astonishingly productive scripting environment in which all manner of solutions can be developed by using tools in appropriate combination. These range from simple automation of routine administrative tasks to post-processing, filtering and report generation from system log files or other structured data sources.

AutoSys is a popular utility for scheduling Linux commands and scripts, providing the ability to link processes using complex interdependencies. Adherence to best practices, like effective error handling and logging, is essential to ensure that workflows are effective.

This 4-day hands-on course shows you how to use this powerful tool-building philosophy by focussing on the bash shell as a programming language, and on many of the key utilities and text filters. You'll also learn how to read, debug and modify real-world scripts within a Linux distribution. Red Hat Linux is used as a platform for hands-on exercises in the course; however the course is not strongly oriented towards any specific distribution.

Intended Audience

The course is valuable for anyone who wishes to become a "power user" of Linux at the command line and from AutoSys command jobs. It will improve the productivity of AutoSys schedule developers, AutoSys schedule support staff, system administrators, developers, network and database managers, in fact anyone who uses AutoSys to run Linux jobs. Attendees should have some previous experience using AutoSys to run jobs and a knowledge of Linux at the command line -- our 2-day course "Introduction to Linux" provides ideal background. Prior exposure to a programming language would also be an advantage.

Key Skills

After completing this course you will be able to:

  • Increase your productivity by using Linux tools effectively
  • Read, understand and modify existing Linux shell scripts
  • Write shell scripts suitable to run from AutoSys
  • Write shell scripts to automate administrative tasks
  • Search, sort, process and reformat text using filters
  • Construct bespoke solutions using tools in combination

Course Outline

  1. Basic utilities
    • Simple filters: cat, wc, head, tail, tr, uniq...
    • Sorting and searching tools: find, sort, grep, wildcards
    • System reporting tools: ls, du, df, ps, netstat, lsof, date ...
    • Stream editing with sed
    • Building solutions by combining tools
  2. Creating Shell Scripts
    • How to create a script
    • Writing and reading with echo and read
    • Passing arguments (positional parameters) to a script
    • Built-in variables and environment variables
    • Redirecting input and output
  3. Searching and matching text with regular expressions
    • Regular Expression syntax
    • Examples using grep
    • Other contexts for using regular expressions
    • Substitutions using tagged regular expressions in sed and vi
  4. Flow control in the shell
    • Conditional execution with if ... else
    • Testing exit status of a command
    • Testing file properties
    • Looping with for, while and until
    • Multiway branching using case
  5. Advanced shell features
    • Defining functions and aliases
    • Command substitution
    • Structuring data with arrays
    • Command sequencing and grouping
    • String operations
    • Writing arithmetic expressions
    • Handling and sending signals: trap and kill
  6. Using awk to process structured input
    • How awk processes lines and fields
    • Patterns and actions
    • Variables, operators and functions
    • Formatted output
    • Looping and branching in awk
  7. Putting it all together
    • Using pipes and command substitution
    • Choosing the right tool for the job
    • Incremental development of solutions
    • Some common idioms
  8. AutoSys Considerations & Recommendations
    • Using Different shells with AutoSys
    • Emulating "auto_remote"
    • Exit codes
    • Log files
    • Environment Variables
    • Shared Code
    • Profiles
    • Executing AutoSys Binaries
    • Accessing the AutoSys Database
    • Script Templates
    • Recommendations
  9. Practical Workshop
    • Student Lab
    • Instructor Demonstrations

Course Duration

3 days

Dr. Chris Brown

Dr. Chris Brown

Course Instructor

Dr. Chris Brown has been using UNIX as a software developer and system administrator since its pioneering days over 30 years ago, and has used Linux professionally and at home for about 10 years. He has written hands-on courses in UNIX/Linux system programming, network programming, PHP, and distributed computing, and has edited and provided instructional design support for many others.

Dr. Brown has taught UNIX and Linux extensively for more than 20 years, in Europe, USA, Canada, India, Hong Kong and Brazil. He provided in-depth technical training on SUSE Linux to Novell’s consultants and IT engineers. He developed training content for Canonical’s “Ubuntu Certified Professional” training and wrote their “Deploying Ubuntu Server” course, and was master trainer for their train-the-trainer program. He is author of the book “UNIX Distributed Programming” published by Prentice Hall, and of “SUSE Linux” published by O’Reilly. He also writes a regular column for the UK magazine “Linux Format”.

Dr Brown is an ardent supporter of Linux and the Open Source movement and brings an enthusiasm, experience, depth of knowledge, and humour to the classroom to make for an effective and enjoyable learning experience. Chris holds a BA in theoretical physics, an MA, and a Ph.D. in particle physics, all from Cambridge University. He also has RedHat RHCE, Novell NCLP and Ubuntu UCP qualifications and is a Ubuntu Certified Instructor.

Antony Askew

Antony Askew

Course Instructor

Antony is a CA Certified AutoSys r11.3 expert, a member of the CA Workload Automation Steering Panel, Chairman of the UK AutoSys User Group and Session Speaker at CA World 2012.

Antony managed CA's EMEA support-desk for AutoSys, managed the AutoSys estates of a number of Global Financial Services companies before joining Extra Technology as CA Practice Manager.

Bhupinder Janjuha

Bhupinder Janjuha

Course Instructor

Bhupinder Janjuha is a CA Certified AutoSys r11.3 expert. Bhupinder managed The EMEA support-desk for AutoSys vendor (before CA) Platinum Technology and was a key member of the team that sold AutoSys throughout Europe during the mid to late 90s.

Bhups later worked as an AutoSys SME / Architect for many of the world's most prestigious AutoSys customers, before co-founding Extra Technology in 2007.

Bhupinder regularly represents CA Technologies as an AutoSys SME, Architect and Educator.

Our Latest Blog Posts

  • Automation Anywhere – the Death of Copy and Paste?

  • Trump Visa Clamp-down and Brexit – good news for RPA?

  • CA Technologies & Automic – an Extra Technology Perspective

  • What customers really want… vendor imperatives for the Application Economy

  • Extra Technology Webinar - CA Workload Automation iDash Speedcast

  • The New CA Workload Automation DE/dSeries Web Interface – a blog by Daniel Chidgey

  • Extra Technology’s Guide to the Top 11 Mistakes made using Workload Automation

  • Migrating CA Technologies customers from Terma Software JAWS™ (JAWS) to CA Workload Automation iDash (CA iDash)

  • Extra Technology confirms the general availability of CA Workload Automation iDash R12

  • A 10 Step Methodology for Successful Workload Automation Conversion

  • Release Automation – The Customer Perspective

  • The Women of IT

  • How to improve your AutoSys workflows

  • Using the AutoSys DBPROC Job Type to execute a database stored procedure

  • How to back out an AutoSys JIL change using Arbiter Software's ACCE

  • Top-secret "Banbury sheets" discovered at Bletchley Park

  • How to monitor text files using the AutoSys OMTF job type

  • How to transfer files using the AutoSys FTP job type

  • How to Integrate CA AutoSys and CA Unified Infrastructure Management (UIM)

  • 2014 CA Workload Automation Technology Summit UK (#WATSUK) Presentation Slides

  • Extra Technology's Sessions At CA World 2014