cluster
You can define one or more clusters for different types of jobs or workloads.
Each cluster has it's own configuration based on your needs.
The format is [cluster <clustername>].
key_name
Name of an existing EC2 KeyPair to enable SSH access to the instances.
template_url
Overrides the path to the cloudformation template used to create the cluster
Defaults to https://s3.amazonaws.com/cfncluster-<aws_region_name>/templates/cfncluster-<version>.cfn.json
.
template_url = https://s3.amazonaws.com/cfncluster-us-east-1/templates/cfncluster.cfn.json
compute_instance_type
The EC2 instance type used for the cluster compute nodes.
Defaults to t2.micro for default template.
compute_instance_type = t2.micro
master_instance_type
The EC2 instance type use for the master node.
This defaults to t2.micro for default template.
master_instance_type = t2.micro
initial_queue_size
The inital number of EC2 instances to launch as compute nodes in the cluster.
The default is 2 for default template.
max_queue_size
The maximum number of EC2 instances that can be launched in the cluster.
This defaults to 10 for the default template.
maintain_initial_size
Boolean flag to set autoscaling group to maintain initial size.
If set to true, the Auto Scaling group will never have fewer members than the value of initial_queue_size. It will still allow the cluster to scale up to the value of max_queue_size.
Setting to false allows the Auto Scaling group to scale down to 0 members, so resources will not sit idle when they aren't needed.
Defaults to false for the default template.
maintain_initial_size = false
scheduler
Scheduler to be used with the cluster. Valid options are sge, openlava, or torque.
Defaults to sge for the default template.
cluster_type
Type of cluster to launch i.e. ondemand or spot
Defaults to ondemand for the default template.
spot_price
If cluster_type is set to spot, the maximum spot price for the ComputeFleet.
custom_ami
ID of a Custom AMI, to use instead of default published AMI's.
s3_read_resource
Specify S3 resource which cfncluster nodes will be granted read-only access
See working with S3 for details on format.
Defaults to NONE for the default template.
s3_read_write_resource
Specify S3 resource which cfncluster nodes will be granted read-write access
See working with S3 for details on format.
Defaults to NONE for the default template.
s3_read_write_resource = NONE
pre_install
URL to a preinstall script. This is executed before any of the boot_as_* scripts are run
Can be specified in "http://hostname/path/to/script.sh" or "s3://bucketname/path/to/script.sh" format.
Defaults to NONE for the default template.
pre_install_args
Quoted list of arguments to be passed to preinstall script
Defaults to NONE for the default template.
post_install
URL to a postinstall script. This is executed after any of the boot_as_* scripts are run
Can be specified in "http://hostname/path/to/script.sh" or "s3://bucketname/path/to/script.sh" format.
Defaults to NONE for the default template.
post_install_args
Arguments to be passed to postinstall script
Defaults to NONE for the default template.
proxy_server
HTTP(S) proxy server, typically http://x.x.x.x:8080
Defaults to NONE for the default template.
placement_group
Cluster placement group. The can be one of three values: NONE, DYNAMIC and an existing placement group name. When DYNAMIC is set, a unique placement group will be created as part of the cluster and deleted when the cluster is deleted.
Defaults to NONE for the default template.
placement
Cluster placment logic. This enables the whole cluster or only compute to use the placement group.
Defaults to cluster in the default template.
ephemeral_dir
If instance store volumes exist, this is the path/mountpoint they will be mounted on.
Defaults to /scratch in the default template.
shared_dir
Path/mountpoint for shared EBS volume
Defaults to /shared in the default template.
encrypted_ephemeral
Encrypted ephemeral drives. In-memory keys, non-recoverable.
Defaults to false in default template.
encrypted_ephemeral = false
master_root_volume_size
MasterServer root volume size in GB. (AMI must support growroot)
Defaults to 10 in default template.
master_root_volume_size = 10
compute_root_volume_size
ComputeFleet root volume size in GB. (AMI must support growroot)
Defaults to 10 in default template.
compute_root_volume_size = 10
base_os
OS type used in the cluster
Defaults to alinux in the default template. Available options are: alinux, centos6, centos7, ubuntu1404:
cwl_region
CloudWatch Logs region
Defaults to NONE in the default template.
cwl_log_group
CloudWatch Logs Log Group name
Defaults to NONE in the default template.
ec2_iam_role
Existing EC2 IAM Role that will be attached to all instances in the cluster.
Defaults to NONE in the default template.
vpc_settings
Settings section relating to VPC to be used
See VPC Section.
ebs_settings
Settings section relating to EBS volume mounted on the master.
See EBS Section.
scaling_settings
Settings section relation to scaling
See Scaling Section.
scaling_settings = custom
vpc
VPC Configuration Settings:
[vpc public]
vpc_id = vpc-xxxxxx
master_subnet_id = subnet-xxxxxx
vpc_id
ID of the VPC you want to provision cluster into.:
master_subnet_id
ID of an existing subnet you want to provision the Master server into.
master_subnet_id = subnet-xxxxxx
ssh_from
CIDR formatted IP range in which to allow SSH access from.
This is only used when cfncluster creates the security group.
Defaults to 0.0.0.0/0 in the default template.
additional_sg
Additional VPC security group Id for all instances.
Defaults to NONE in the default template.
additional_sg = sg-xxxxxx
compute_subnet_id
ID of an existing subnet you want to provision the compute nodes into.
compute_subnet_id = subnet-xxxxxx
compute_subnet_cidr
If you wish for cfncluster to create a compute subnet, this is the CIDR that.
compute_subnet_cidr = 10.0.100.0/24
use_public_ips
Define whether or not to assign public IP addresses to EC2 instances.
Set to false if operating in a private VPC.
Defaults to true.
vpc_security_group_id
Use an existing security group for all instances.
Defaults to NONE in the default template.
vpc_security_group_id = sg-xxxxxx
ebs
EBS Volume configuration settings for the volume mounted on the master node and shared via NFS to compute nodes.
[ebs custom]
ebs_snapshot_id = snap-xxxxx
volume_type = io1
volume_iops = 200
ebs_snapshot_id
Id of EBS snapshot if using snapshot as source for volume.
Defaults to NONE for default template.
ebs_snapshot_id = snap-xxxxx
volume_type
The API name for the type of volume you wish to launch.
Defaults to gp2 for default template.
volume_size
Size of volume to be created (if not using a snapshot).
Defaults to 20GB for default template.
volume_iops
Number of IOPS for io1 type volumes.
encrypted
Whether or not the volume should be encrypted (should not be used with snapshots).
Defaults to false for default template.
ebs_volume_id
EBS Volume Id of an existing volume that will be attached to the MasterServer.
Defaults to NONE for default template.
ebs_volume_id = vol-xxxxxx
scaling
Settings which define how the compute nodes scale.
[scaling custom]
scaling_period = 60
scaling_cooldown = 300
scaling_threshold
Threshold for triggering CloudWatch ScaleUp action.
Defaults to 1 for default template.
scaling_adjustment
Number of instances to add when called CloudWatch ScaleUp action.
Defaults to 1 for default template.
scaling_threshold2
Threshold for triggering CloudWatch ScaleUp2 action.
Defaults to 200 for default template.
scaling_adjustment2
Number of instances to add when called CloudWatch ScaleUp2 action
Defaults to 20 for default template.
scaling_period
Period to measure ScalingThreshold.
Defaults to 60 for default template.
scaling_evaluation_periods
Number of periods to measure ScalingThreshold.
Defaults to 2 for default template.
scaling_evaluation_periods = 2
scaling_cooldown
Amount of time in seconds to wait before attempting further scaling actions.
Defaults to 300 for the default template.