-- Logs begin at Sat 2022-07-23 20:01:16 UTC, end at Sat 2022-07-23 22:43:39 UTC. -- Jul 23 21:04:02.965026 ncdv-master-1 systemd[1]: Started Devstack devstack@c-sch.service. Jul 23 21:04:06.476633 ncdv-master-1 cinder-scheduler[123551]: INFO dbcounter [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] Registered counter for database cinder Jul 23 21:04:06.513227 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:04:06.525898 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writer thread running {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:04:06.886673 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.rpc [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 23 21:04:06.891713 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.rpc [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Jul 23 21:04:06.900268 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:04:06.905635 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.rpc [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Jul 23 21:04:06.910608 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.rpc [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Jul 23 21:04:06.916087 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.rpc [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 23 21:04:06.921081 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.rpc [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 23 21:04:06.930500 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:04:06.955006 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_concurrency.lockutils [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] Acquired lock "singleton_lock" {{(pid=123551) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 23 21:04:06.955478 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_concurrency.lockutils [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] Releasing lock "singleton_lock" {{(pid=123551) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 23 21:04:06.956005 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] ******************************************************************************** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 23 21:04:06.956460 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] Configuration options gathered from: {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 23 21:04:06.956908 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 23 21:04:06.964785 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 23 21:04:06.964785 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] ================================================================================ {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 23 21:04:06.964785 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] allocated_capacity_weight_multiplier = -1.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.964785 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] allow_availability_zone_fallback = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.964785 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] allow_compression_on_image_upload = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.964785 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] allowed_direct_url_schemes = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.964785 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] api_rate_limit = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.965567 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] auth_strategy = keystone {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.965567 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] az_cache_duration = 3600 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.965567 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backdoor_port = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.965567 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backdoor_socket = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.965567 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_availability_zone = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.965964 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backup_api_class = cinder.backup.api.API {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.968816 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.968816 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backup_name_template = backup-%s {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.968816 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backup_use_same_host = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.968816 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backup_use_temp_snapshot = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.968816 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] capacity_weight_multiplier = 1.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.969299 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] chap_password = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.969386 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] chap_username = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.969763 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.970601 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_internal_tenant_project_id = 4804ed61295f4d4a92d9b685dd9e9f3b {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.977887 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_internal_tenant_user_id = ec5fd3a489c341b7964704d689037f05 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.977887 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cloned_volume_same_az = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.977887 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] compression_format = gzip {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.977887 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] compute_api_class = cinder.compute.nova.API {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.977887 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] config_dir = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.977887 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.977887 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] config_source = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.978643 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.978643 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] control_exchange = openstack {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.978643 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] debug = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.978643 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] default_availability_zone = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.978643 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] default_group_type = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.979054 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.979054 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] default_volume_type = ceph {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.979054 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] driver_client_cert = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.979529 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] driver_client_cert_key = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.980184 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] driver_data_namespace = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.980794 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] driver_ssl_cert_path = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.981767 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] driver_ssl_cert_verify = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.982525 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] driver_use_ssl = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.982945 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] enable_force_upload = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.983523 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] enable_new_services = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.983971 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] enable_unsupported_driver = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.984381 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] enabled_backends = ['ceph'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.984872 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] enforce_multipath_for_image_xfer = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.985325 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] filter_function = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.985699 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_api_insecure = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.986115 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_api_servers = ['http://10.222.0.17/image'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.986503 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_api_ssl_compression = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.986851 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_ca_certificates_file = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.987234 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_catalog_info = image:glance:publicURL {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.989832 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_certfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.989832 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.989832 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_keyfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.989832 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_num_retries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.989832 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_request_timeout = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.989832 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] goodness_function = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.990360 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] graceful_shutdown_timeout = 5 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.990360 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] group_api_class = cinder.group.api.API {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.990757 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] host = ncdv-master-1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.991261 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iet_conf = /etc/iet/ietd.conf {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.994261 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_compress_on_upload = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.994261 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_conversion_address_space_limit = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.994261 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_conversion_cpu_limit = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.994261 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.994261 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_conversion_disable = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.994261 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_upload_use_cinder_backend = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.994826 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_upload_use_internal_tenant = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.995084 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_volume_cache_enabled = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.997272 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_volume_cache_max_count = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.997272 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_volume_cache_max_size_gb = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.997272 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] instance_format = [instance: %(uuid)s] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:06.997272 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.001652 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iscsi_iotype = fileio {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.003990 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iscsi_secondary_ip_addresses = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.010642 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iscsi_target_flags = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.010642 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iscsi_write_cache = on {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.010642 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iser_helper = tgtadm {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.012492 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iser_ip_address = 10.222.0.17 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.013419 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iser_port = 3260 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.013839 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.015536 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_config_append = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.015939 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.016352 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_dir = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.016732 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_file = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.020043 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_options = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.020043 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_rotate_interval = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.020043 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_rotate_interval_type = days {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.020439 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_rotation_type = none {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.021687 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.023564 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.024036 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.024481 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.025986 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.026435 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] max_age = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.026844 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] max_logfile_count = 30 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.027286 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] max_logfile_size_mb = 200 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.028162 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] max_over_subscription_ratio = 20.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.028611 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] message_reap_interval = 86400 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.030142 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] message_ttl = 2592000 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.030463 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] monkey_patch = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.030867 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] monkey_patch_modules = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.031190 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] my_ip = 10.222.0.17 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.031615 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] no_snapshot_gb_quota = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.031985 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] num_iser_scan_tries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.032436 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] num_shell_tries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.033281 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] num_volume_device_scan_tries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.034796 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nvmet_ns_id = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.035180 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nvmet_port_id = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.035976 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] osapi_max_limit = 1000 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.036452 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] osapi_volume_ext_list = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.037041 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.037441 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] osapi_volume_listen = 0.0.0.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.037888 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] osapi_volume_listen_port = 8776 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.038752 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] osapi_volume_use_ssl = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.039153 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] osapi_volume_workers = 2 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.039552 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] per_volume_size_limit = -1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.040469 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] periodic_fuzzy_delay = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.040859 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] periodic_interval = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.042165 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] project_id_regex = [0-9a-f\-]+ {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.042591 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] public_endpoint = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.042970 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] publish_errors = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.043345 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_backup_gigabytes = 1000 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.045259 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_backups = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.045712 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_consistencygroups = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.047439 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.047858 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_gigabytes = 1000 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.048252 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_groups = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.048764 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_snapshots = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.049137 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_volumes = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.049511 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] rate_limit_burst = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.049919 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] rate_limit_except_level = CRITICAL {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.050338 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] rate_limit_interval = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.050711 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] replication_device = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.051086 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] report_discard_supported = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.052603 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] report_interval = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.053091 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] reservation_clean_interval = 86400 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.053412 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] reservation_expire = 86400 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.055585 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] reserved_percentage = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.056412 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.057831 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.058337 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] rpc_response_timeout = 120 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.059931 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] run_external_periodic_tasks = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.060473 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_default_filters = ['AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.060895 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_default_weighers = ['CapacityWeigher'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.061323 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_driver = cinder.scheduler.filter_scheduler.FilterScheduler {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.061775 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_driver_init_wait_time = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.063747 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_host_manager = cinder.scheduler.host_manager.HostManager {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.064166 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_json_config_location = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.065197 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.067040 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_max_attempts = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.067471 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_weight_handler = cinder.scheduler.weights.OrderedHostWeightHandler {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.067871 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scst_target_driver = iscsi {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.068239 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scst_target_iqn_name = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.068612 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_down_time = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.068994 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] snapshot_name_template = snapshot-%s {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.069364 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] snapshot_same_host = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.069729 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] split_loggers = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.070081 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] state_path = /opt/stack/data/cinder {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.070461 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] storage_availability_zone = nova {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.070844 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] storage_protocol = iSCSI {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.071218 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] syslog_log_facility = LOG_USER {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.071620 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] target_helper = lioadm {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.072169 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] target_ip_address = 10.222.0.17 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.072538 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] target_port = 3260 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.072909 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.073820 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] target_protocol = iscsi {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.074279 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] trace_flags = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.075807 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] transfer_api_class = cinder.transfer.api.API {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.076199 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] transport_url = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.076636 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] until_refresh = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.077476 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_chap_auth = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.077932 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_default_quota_class = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.078311 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_eventlog = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.078680 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_journal = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.079081 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_json = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.079451 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_multipath_for_image_xfer = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.079838 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_stderr = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.080273 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_syslog = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.080661 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] verify_glance_signatures = enabled {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.081058 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_api_class = cinder.volume.api.API {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.081417 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_backend_name = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.082416 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_clear = zero {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.082854 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_clear_ionice = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.084096 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_clear_size = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.084558 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.084949 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_copy_bps_limit = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.085336 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_dd_blocksize = 1M {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.087838 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.088311 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_name_template = volume-%s {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.088701 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_number_multiplier = -1.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.089715 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_usage_audit_period = month {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.089715 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.091143 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] watch_log_file = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.091577 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.091968 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.092367 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_concurrency.disable_process_locking = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.092860 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.093254 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.093634 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.094077 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.094610 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.095024 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.095424 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.admin_password = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.095888 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.096264 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.admin_token = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.096648 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.admin_user = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.097063 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_admin_prefix = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.098037 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.098477 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_port = 35357 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.098876 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_protocol = https {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.099314 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_section = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.099712 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_type = password {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.100127 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_uri = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.100529 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_version = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.100879 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.cache = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.101270 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.101639 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.certfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.102088 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.delay_auth_decision = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.102496 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.102932 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.http_connect_timeout = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.103307 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.103672 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.identity_uri = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.104057 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.include_service_catalog = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.104431 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.insecure = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.104813 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.interface = public {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.105246 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.keyfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.105626 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.106956 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.107340 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.108241 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.108627 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.109002 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.109457 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.109841 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.111827 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.112222 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.region_name = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.112633 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.113035 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.service_token_roles_required = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.113444 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.service_type = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.113824 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.token_cache_time = 300 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.114306 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.114791 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.backend = dogpile.cache.null {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.115171 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.backend_argument = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.115636 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.config_prefix = cache.oslo {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.116079 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.dead_timeout = 60.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.116457 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.debug_cache_backend = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.116834 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.enable_retry_client = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.117204 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.enable_socket_keepalive = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.117571 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.enabled = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.118709 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.expiration_time = 600 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.119093 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.hashclient_retry_attempts = 2 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.119478 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.hashclient_retry_delay = 1.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.119935 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.memcache_dead_retry = 300 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.120313 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.120715 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.121152 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.memcache_pool_maxsize = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.123183 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.123627 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.124020 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.memcache_socket_timeout = 1.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.124408 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.proxies = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.124788 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.retry_attempts = 2 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.125165 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.retry_delay = 0.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.125542 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.socket_keepalive_count = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.126112 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.socket_keepalive_idle = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.126490 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.socket_keepalive_interval = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.126859 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.tls_allowed_ciphers = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.127224 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.tls_cafile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.127587 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.tls_certfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.127969 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.tls_enabled = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.129500 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.tls_keyfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.129949 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] coordination.backend_url = etcd3+http://10.222.0.17:2379 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.130421 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.backend = sqlalchemy {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.130824 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.connection = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.131205 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.connection_debug = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.131651 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.connection_parameters = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.132114 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.connection_recycle_time = 3600 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.132580 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.connection_trace = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.133023 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.db_inc_retry_interval = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.133470 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.db_max_retries = 20 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.133845 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.db_max_retry_interval = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.134255 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.db_retry_interval = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.134635 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.max_overflow = 50 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.135034 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.max_pool_size = 5 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.135432 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.max_retries = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.135876 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.mysql_enable_ndb = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.136267 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.136680 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.pool_timeout = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.137054 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.retry_interval = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.137425 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.slave_connection = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.137804 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.sqlite_synchronous = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.139586 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.use_db_reconnect = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.139990 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.enforce_new_defaults = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.140381 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.enforce_scope = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.140867 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.policy_default_rule = default {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.141304 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.141699 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.policy_file = policy.yaml {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.142219 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.142592 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.142963 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.143692 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.144056 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.144451 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.connection_string = messaging:// {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.144828 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.enabled = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.145208 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.es_doc_type = notification {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.145581 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.es_scroll_size = 10000 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.145990 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.es_scroll_time = 2m {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.146362 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.filter_error_trace = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.146800 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.hmac_keys = SECRET_KEY {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.147187 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.sentinel_service_name = mymaster {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.147637 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.socket_timeout = 0.1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.148013 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.trace_sqlalchemy = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.148450 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] os_brick.lock_path = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.148902 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] privsep_osbrick.capabilities = [21] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.149885 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] privsep_osbrick.group = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.150323 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] privsep_osbrick.helper_command = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.150728 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.151116 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.151485 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] privsep_osbrick.user = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.151875 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.152240 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_sys_admin.group = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.152623 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_sys_admin.helper_command = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.153066 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.153439 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.153822 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_sys_admin.user = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.154294 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.auth_section = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.154674 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.auth_type = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.155049 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.cafile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.155485 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.certfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.155862 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.collect_timing = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.156251 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.insecure = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.156683 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.keyfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.157118 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.send_service_user_token = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.157488 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.split_loggers = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.157852 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.timeout = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.161067 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.backend_availability_zone = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.161482 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.chap_password = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.161934 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.chap_username = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.162383 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.162765 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.driver_client_cert = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.163136 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.driver_client_cert_key = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.164069 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.driver_data_namespace = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.164497 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.164878 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.165254 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.driver_use_ssl = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.165652 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.enable_unsupported_driver = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.166304 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.166682 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.filter_function = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.167085 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.goodness_function = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.167521 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.167898 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.168291 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.168665 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.169137 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.169518 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.171403 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iscsi_iotype = fileio {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.171887 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.172313 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iscsi_target_flags = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.172747 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iscsi_write_cache = on {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.173158 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iser_helper = tgtadm {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.173685 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iser_ip_address = 10.222.0.17 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.174090 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iser_port = 3260 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.174477 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.174868 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.175244 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.175618 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.num_shell_tries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.175992 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.177940 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.178381 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.nvmet_port_id = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.178831 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.replication_device = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.179219 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.report_discard_supported = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.179647 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.reserved_percentage = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.180060 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.scst_target_driver = iscsi {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.180507 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.scst_target_iqn_name = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.180897 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.storage_protocol = iSCSI {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.181969 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.target_helper = tgtadm {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.182500 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.target_ip_address = 10.222.0.17 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.182953 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.target_port = 3260 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.183343 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.183736 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.target_protocol = iscsi {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.184224 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.trace_flags = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.184607 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.unique_fqdn_network = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.184976 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.use_chap_auth = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.185350 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.185718 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volume_backend_name = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.186126 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volume_clear = zero {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.186493 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volume_clear_ionice = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.186867 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volume_clear_size = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.187246 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.187623 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.188122 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.188670 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.189153 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_reports.file_event_handler = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.189559 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.192187 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_reports.log_dir = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.192698 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.193096 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.193515 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.193978 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.194376 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.194763 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.195166 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.195549 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.195933 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.196462 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.196867 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.197265 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.197729 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.198283 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.198658 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.199121 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.199525 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.199882 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.200275 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.200648 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.201021 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.201410 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.201783 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.202621 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.203008 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.203395 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.ssl = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.203814 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.204211 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.204582 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.205042 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.205428 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.ssl_version = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.205818 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_notifications.driver = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.207213 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_notifications.retry = -1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.207629 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.208143 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_notifications.transport_url = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.208535 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.auth_section = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.208989 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.auth_type = password {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.209410 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.209759 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.certfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.211797 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.collect_timing = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.212653 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.insecure = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.213054 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.interface = public {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.213425 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.keyfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.213810 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.region_name = RegionOne {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.214222 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.split_loggers = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.214589 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.timeout = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.214951 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.token_auth_url = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.215327 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] ******************************************************************************** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 23 21:04:07.215771 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] Full set of CONF: {{(pid=123551) _wait_for_exit_or_signal /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:362}} Jul 23 21:04:07.216075 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] ******************************************************************************** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 23 21:04:07.216429 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] Configuration options gathered from: {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 23 21:04:07.216729 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 23 21:04:07.217028 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 23 21:04:07.217307 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] ================================================================================ {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 23 21:04:07.217676 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] allocated_capacity_weight_multiplier = -1.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.218010 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] allow_availability_zone_fallback = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.218472 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] allow_compression_on_image_upload = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.218843 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] allowed_direct_url_schemes = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.219134 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] api_rate_limit = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.219494 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] auth_strategy = keystone {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.219861 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] az_cache_duration = 3600 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.220143 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backdoor_port = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.220448 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backdoor_socket = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.220750 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_availability_zone = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.221091 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backup_api_class = cinder.backup.api.API {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.221382 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.221669 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backup_name_template = backup-%s {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.223695 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backup_use_same_host = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.224022 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backup_use_temp_snapshot = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.224327 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] capacity_weight_multiplier = 1.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.224620 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] chap_password = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.224913 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] chap_username = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.225203 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.226126 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_internal_tenant_project_id = 4804ed61295f4d4a92d9b685dd9e9f3b {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.226427 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_internal_tenant_user_id = ec5fd3a489c341b7964704d689037f05 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.226717 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cloned_volume_same_az = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.227004 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] compression_format = gzip {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.227698 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] compute_api_class = cinder.compute.nova.API {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.228026 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] config_dir = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.228539 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.228855 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] config_source = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.229148 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.229501 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] control_exchange = openstack {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.229790 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] debug = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.230100 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] default_availability_zone = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.230401 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] default_group_type = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.230721 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.231083 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] default_volume_type = ceph {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.231373 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] driver_client_cert = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.231678 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] driver_client_cert_key = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.231962 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] driver_data_namespace = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.232245 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] driver_ssl_cert_path = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.232527 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] driver_ssl_cert_verify = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.232808 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] driver_use_ssl = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.233089 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] enable_force_upload = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.233823 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] enable_new_services = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.234135 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] enable_unsupported_driver = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.234423 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] enabled_backends = ['ceph'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.234704 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] enforce_multipath_for_image_xfer = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.235016 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] filter_function = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.235307 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_api_insecure = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.235591 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_api_servers = ['http://10.222.0.17/image'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.235875 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_api_ssl_compression = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.237147 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_ca_certificates_file = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.237466 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_catalog_info = image:glance:publicURL {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.237810 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_certfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.238166 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.238602 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_keyfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.238899 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_num_retries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.239257 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] glance_request_timeout = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.239546 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] goodness_function = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.239844 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] graceful_shutdown_timeout = 5 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.240859 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] group_api_class = cinder.group.api.API {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.241155 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] host = ncdv-master-1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.241441 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iet_conf = /etc/iet/ietd.conf {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.241724 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_compress_on_upload = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.242048 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_conversion_address_space_limit = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.242330 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_conversion_cpu_limit = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.242688 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.242985 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_conversion_disable = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.243269 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_upload_use_cinder_backend = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.244859 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_upload_use_internal_tenant = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.245160 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_volume_cache_enabled = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.245519 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_volume_cache_max_count = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.245810 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] image_volume_cache_max_size_gb = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.246146 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] instance_format = [instance: %(uuid)s] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.246450 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.246733 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iscsi_iotype = fileio {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.247017 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iscsi_secondary_ip_addresses = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.247368 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iscsi_target_flags = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.247653 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iscsi_write_cache = on {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.247955 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iser_helper = tgtadm {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.248237 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iser_ip_address = 10.222.0.17 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.248518 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iser_port = 3260 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.249424 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.249707 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_config_append = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.250018 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.250307 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_dir = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.250587 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_file = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.251056 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_options = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.251346 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_rotate_interval = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.251630 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_rotate_interval_type = days {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.251912 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] log_rotation_type = none {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.252192 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.252473 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.252755 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.253143 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.253430 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.253736 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] max_age = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.254040 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] max_logfile_count = 30 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.254368 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] max_logfile_size_mb = 200 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.255063 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] max_over_subscription_ratio = 20.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.255356 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] message_reap_interval = 86400 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.255653 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] message_ttl = 2592000 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.255939 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] monkey_patch = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.256220 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] monkey_patch_modules = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.256506 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] my_ip = 10.222.0.17 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.256861 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] no_snapshot_gb_quota = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.257149 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] num_iser_scan_tries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.257449 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] num_shell_tries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.257732 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] num_volume_device_scan_tries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.258104 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nvmet_ns_id = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.258394 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nvmet_port_id = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.258697 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] osapi_max_limit = 1000 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.258980 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] osapi_volume_ext_list = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.259398 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.259685 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] osapi_volume_listen = 0.0.0.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.259967 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] osapi_volume_listen_port = 8776 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.260321 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] osapi_volume_use_ssl = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.260606 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] osapi_volume_workers = 2 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.261006 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] per_volume_size_limit = -1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.261301 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] periodic_fuzzy_delay = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.261575 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] periodic_interval = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.261855 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] project_id_regex = [0-9a-f\-]+ {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.262154 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] public_endpoint = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.262435 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] publish_errors = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.262713 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_backup_gigabytes = 1000 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.262990 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_backups = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.263269 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_consistencygroups = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.263575 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.263895 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_gigabytes = 1000 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.264243 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_groups = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.264523 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_snapshots = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.265260 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] quota_volumes = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.265545 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] rate_limit_burst = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.265825 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] rate_limit_except_level = CRITICAL {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.267216 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] rate_limit_interval = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.267507 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] replication_device = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.267795 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] report_discard_supported = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.268079 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] report_interval = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.268740 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] reservation_clean_interval = 86400 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.269055 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] reservation_expire = 86400 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.269499 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] reserved_percentage = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.269810 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.270241 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.270549 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] rpc_response_timeout = 120 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.270834 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] run_external_periodic_tasks = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.271346 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_default_filters = ['AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.271619 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_default_weighers = ['CapacityWeigher'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.271924 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_driver = cinder.scheduler.filter_scheduler.FilterScheduler {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.272224 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_driver_init_wait_time = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.272558 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_host_manager = cinder.scheduler.host_manager.HostManager {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.272842 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_json_config_location = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.273123 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.273408 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_max_attempts = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.273687 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scheduler_weight_handler = cinder.scheduler.weights.OrderedHostWeightHandler {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.273989 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scst_target_driver = iscsi {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.274274 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] scst_target_iqn_name = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.274551 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_down_time = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.275073 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] snapshot_name_template = snapshot-%s {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.275523 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] snapshot_same_host = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.275810 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] split_loggers = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.276093 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] state_path = /opt/stack/data/cinder {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.276393 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] storage_availability_zone = nova {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.276730 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] storage_protocol = iSCSI {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.277013 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] syslog_log_facility = LOG_USER {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.277303 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] target_helper = lioadm {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.277579 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] target_ip_address = 10.222.0.17 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.277887 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] target_port = 3260 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.278244 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.278567 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] target_protocol = iscsi {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.278849 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] trace_flags = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.279146 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] transfer_api_class = cinder.transfer.api.API {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.280381 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] transport_url = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.280712 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] until_refresh = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.281385 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_chap_auth = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.281689 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_default_quota_class = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.282111 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_eventlog = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.282468 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_journal = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.282760 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_json = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.283049 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_multipath_for_image_xfer = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.283334 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_stderr = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.283618 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] use_syslog = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.283903 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] verify_glance_signatures = enabled {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.284189 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_api_class = cinder.volume.api.API {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.284470 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_backend_name = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.284752 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_clear = zero {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.286517 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_clear_ionice = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.286839 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_clear_size = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.287127 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.287435 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_copy_bps_limit = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.287803 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_dd_blocksize = 1M {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.288092 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.288380 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_name_template = volume-%s {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.288668 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_number_multiplier = -1.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.288954 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volume_usage_audit_period = month {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.289235 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.289518 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] watch_log_file = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:04:07.290587 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.290587 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.290788 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_concurrency.disable_process_locking = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.291005 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.292654 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.292971 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.293270 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.293558 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.293880 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.294277 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.admin_password = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.294569 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.294860 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.admin_token = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.295150 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.admin_user = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.295435 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_admin_prefix = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.295722 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.296027 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_port = 35357 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.297440 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_protocol = https {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.297823 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_section = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.298164 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_type = password {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.298457 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_uri = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.298830 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.auth_version = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.299132 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.cache = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.299424 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.299714 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.certfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.300017 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.delay_auth_decision = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.300312 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.300818 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.http_connect_timeout = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.301113 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.301406 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.identity_uri = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.301694 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.include_service_catalog = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.302966 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.insecure = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.302966 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.interface = public {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.302966 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.keyfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.303200 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.303457 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.303644 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.303938 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.304221 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.304503 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.304791 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.305075 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.305361 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.305645 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.region_name = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.305981 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.306265 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.service_token_roles_required = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.306550 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.service_type = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.306859 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.token_cache_time = 300 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.307143 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.307793 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.backend = dogpile.cache.null {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.308088 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.backend_argument = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.308370 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.config_prefix = cache.oslo {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.308657 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.dead_timeout = 60.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.308942 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.debug_cache_backend = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.309223 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.enable_retry_client = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.309503 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.enable_socket_keepalive = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.309906 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.enabled = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.310242 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.expiration_time = 600 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.310587 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.hashclient_retry_attempts = 2 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.311010 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.hashclient_retry_delay = 1.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.311304 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.memcache_dead_retry = 300 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.311686 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.311983 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.312364 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.memcache_pool_maxsize = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.312969 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.313309 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.313602 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.memcache_socket_timeout = 1.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.313930 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.proxies = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.314226 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.retry_attempts = 2 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.314512 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.retry_delay = 0.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.314798 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.socket_keepalive_count = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.315128 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.socket_keepalive_idle = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.315472 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.socket_keepalive_interval = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.315701 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.tls_allowed_ciphers = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.315984 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.tls_cafile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.316266 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.tls_certfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.316549 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.tls_enabled = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.316832 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cache.tls_keyfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.317122 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] coordination.backend_url = etcd3+http://10.222.0.17:2379 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.317743 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.backend = sqlalchemy {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.318063 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.connection = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.319017 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.connection_debug = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.320443 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.connection_parameters = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.320911 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.connection_recycle_time = 3600 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.321217 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.connection_trace = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.321510 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.db_inc_retry_interval = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.321797 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.db_max_retries = 20 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.322112 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.db_max_retry_interval = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.322401 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.db_retry_interval = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.322690 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.max_overflow = 50 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.324199 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.max_pool_size = 5 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.324514 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.max_retries = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.324813 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.mysql_enable_ndb = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.325106 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.325415 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.pool_timeout = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.325797 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.retry_interval = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.326201 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.slave_connection = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.326499 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.sqlite_synchronous = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.326786 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] database.use_db_reconnect = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.327178 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.enforce_new_defaults = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.327472 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.enforce_scope = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.328084 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.policy_default_rule = default {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.328381 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.328668 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.policy_file = policy.yaml {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.329100 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.329400 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.329701 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.330773 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.330773 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.330773 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.connection_string = messaging:// {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.331049 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.enabled = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.331470 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.es_doc_type = notification {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.331639 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.es_scroll_size = 10000 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.331922 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.es_scroll_time = 2m {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.332210 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.filter_error_trace = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.332567 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.hmac_keys = SECRET_KEY {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.332853 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.sentinel_service_name = mymaster {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.333169 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.socket_timeout = 0.1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.333453 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] profiler.trace_sqlalchemy = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.333745 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] os_brick.lock_path = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.334414 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] privsep_osbrick.capabilities = [21] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.334705 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] privsep_osbrick.group = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.335011 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] privsep_osbrick.helper_command = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.335298 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.335582 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.335867 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] privsep_osbrick.user = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.336164 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.336447 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_sys_admin.group = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.336732 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_sys_admin.helper_command = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.337011 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.337298 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.337577 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] cinder_sys_admin.user = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.338131 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.auth_section = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.338426 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.auth_type = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.338708 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.cafile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.338991 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.certfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.339276 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.collect_timing = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.339556 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.insecure = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.339877 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.keyfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.340118 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.send_service_user_token = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.340410 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.split_loggers = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.340764 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] service_user.timeout = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.341182 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.backend_availability_zone = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.341478 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.chap_password = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.341759 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.chap_username = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.342062 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.342346 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.driver_client_cert = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.342627 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.driver_client_cert_key = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.342908 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.driver_data_namespace = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.343187 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.343466 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.343745 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.driver_use_ssl = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.344024 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.enable_unsupported_driver = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.344546 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.344835 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.filter_function = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.345116 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.goodness_function = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.345400 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.345687 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.345996 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.346280 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.346562 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.346842 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.347121 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iscsi_iotype = fileio {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.347403 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.347684 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iscsi_target_flags = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.348215 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iscsi_write_cache = on {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.348605 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iser_helper = tgtadm {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.348914 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iser_ip_address = 10.222.0.17 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.349218 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iser_port = 3260 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.349505 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.349782 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.350092 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.350453 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.num_shell_tries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.350738 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.351025 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.351422 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.nvmet_port_id = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.351736 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.replication_device = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.352018 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.report_discard_supported = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.352301 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.reserved_percentage = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.352580 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.scst_target_driver = iscsi {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.352862 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.scst_target_iqn_name = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.353214 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.storage_protocol = iSCSI {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.353505 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.target_helper = tgtadm {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.353793 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.target_ip_address = 10.222.0.17 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.354097 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.target_port = 3260 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.354598 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.354885 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.target_protocol = iscsi {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.355191 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.trace_flags = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.355523 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.unique_fqdn_network = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.355808 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.use_chap_auth = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.356115 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.356464 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volume_backend_name = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.356755 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volume_clear = zero {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.357037 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volume_clear_ionice = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.357319 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volume_clear_size = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.357601 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.357919 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.358450 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.358742 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.359036 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_reports.file_event_handler = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.359319 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.359601 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_reports.log_dir = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.359902 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.360249 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.360539 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.360811 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.361098 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.361487 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.361773 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.362093 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.362375 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.362655 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.362933 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.363214 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.363500 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.363779 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.364057 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.364505 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.365122 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.365122 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.365396 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.365691 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.365978 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.366228 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.366508 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.366790 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.367067 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.367539 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.ssl = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.367638 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.367910 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.368284 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.368701 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.368989 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_rabbit.ssl_version = {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.369281 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_notifications.driver = [] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.369561 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_notifications.retry = -1 {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.369846 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.370165 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] oslo_messaging_notifications.transport_url = **** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.370462 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.auth_section = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.370885 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.auth_type = password {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.371004 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.371334 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.certfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.372298 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.collect_timing = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.372525 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.insecure = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.372830 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.interface = public {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.373093 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.keyfile = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.373379 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.region_name = RegionOne {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.373663 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.split_loggers = False {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.373972 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.timeout = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.374257 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] nova.token_auth_url = None {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:04:07.374756 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.service [None req-92f48a04-040c-4b83-9e38-c594e5105b49 None None] ******************************************************************************** {{(pid=123551) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 23 21:04:07.375234 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.service [-] Starting cinder-scheduler node (version 20.1.0) Jul 23 21:04:07.378163 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.manager [None req-16ddc91e-b19b-40f9-81c0-709e52fe1a57 None None] Initiating service 1 cleanup Jul 23 21:04:07.387669 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.manager [None req-16ddc91e-b19b-40f9-81c0-709e52fe1a57 None None] Service 1 cleanup completed. Jul 23 21:04:07.388066 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-16ddc91e-b19b-40f9-81c0-709e52fe1a57 None None] Creating RPC server for service cinder-scheduler {{(pid=123551) start /opt/stack/cinder/cinder/service.py:238}} Jul 23 21:04:07.396042 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.service [None req-16ddc91e-b19b-40f9-81c0-709e52fe1a57 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=123551) start /opt/stack/cinder/cinder/service.py:244}} Jul 23 21:04:09.434315 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-7a475d0e-dca6-41d2-bc7e-7a96af997115 None None] Received backup service update from ncdv-master-1: {'backend_state': False, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:04:11.782083 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-b3a293fb-6fa5-4143-b47a-bbe44e4306f9 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:04:11.794405 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-b3a293fb-6fa5-4143-b47a-bbe44e4306f9 None None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 7, 23, 21, 4, 11, 751393)} {{(pid=123551) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Jul 23 21:04:19.509251 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.periodic_task [None req-31dc2eb7-5841-4953-bb38-bb033448c91e None None] Running periodic task SchedulerManager._clean_expired_messages {{(pid=123551) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 23 21:04:19.515585 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-31dc2eb7-5841-4953-bb38-bb033448c91e None None] Deleted 0 expired messages. Jul 23 21:04:19.515936 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_service.periodic_task [None req-31dc2eb7-5841-4953-bb38-bb033448c91e None None] Running periodic task SchedulerManager._clean_expired_reservation {{(pid=123551) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Jul 23 21:04:42.508644 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=34,cinder:INSERT=1,cinder:DELETE=1,cinder:UPDATE=2 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:05:22.520932 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:02.523866 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:07.511179 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-1733f0db-b422-4f17-84a4-503ab3bbf1e9 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:06:10.060426 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-8648d505-84b5-41a7-8301-c9398b9bb7aa None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:06:32.536806 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:07:07.508638 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-bdb31e91-09a4-4e83-adff-04408f2d1df1 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:07:10.054735 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-c5e93c32-8940-47e2-b3f9-e050c3a6bc89 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:07:12.543612 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:07:52.549074 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:08:07.508695 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-719a2740-0a42-4cd0-af4e-655286ce1e14 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:08:10.053289 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-d6c6acbb-d9f0-4b43-a65a-06c3365d4c1f None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:08:22.562336 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:08:52.569774 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:09:07.506700 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-25537756-dd79-4c78-afef-e333d629f5ca None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:09:10.052232 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-9b3d6695-0803-458e-969a-c3a326ba0ae7 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:09:32.569425 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:10:07.504470 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-810e1131-dbcc-4e6b-b9b1-f55df9131cde None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:10:10.054831 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-289d7115-e434-4029-8c08-18a812dc75bc None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:10:12.572082 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:10:52.571009 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:11:07.501926 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-f7b93942-d404-4f84-b60b-d350aef06371 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:11:10.059647 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-ad4bb05c-5d89-4cbf-a15e-c1bcdff364a7 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:11:32.570157 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:12:07.498389 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-d5337ca9-ae20-471a-acab-7bd60e848b5a None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:12:10.055785 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-eaf3870e-f759-4824-b24e-6cb059be579a None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:12:12.571644 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:12:52.574388 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:07.506562 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-84e4b7c6-d889-4d2a-a2a3-45ac5d0fa8e2 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:13:10.053975 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-bba83a05-c773-46c9-b57f-78322ebc34af None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:13:22.585356 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:02.598690 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:07.503936 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-35ce6631-c195-4c57-8c80-8c22f26ef142 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:14:10.163216 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-dc7f363e-656b-45e2-809c-73aada76f7ba None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:14:42.603057 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:07.507538 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-b22bbc52-bc72-4713-b537-6ebe436dc5b3 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:15:10.138584 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-70992073-0568-4337-8791-4550ad3e4b41 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:15:22.617047 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:02.627789 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:07.499752 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-eff3e293-9fe7-4908-a7f5-bff4afbc15be None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:16:10.127640 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-587f3f15-9c27-45a6-a046-a31104110a1e None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:16:42.611951 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:07.503003 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-93beca41-4cfd-4874-aba6-8788598777d3 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:17:09.864249 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Flow 'volume_create_scheduler' (367cb602-d87c-4389-823d-c65b7159d996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:17:09.872567 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (efa4e9ae-90ed-49ad-9b00-bcd07a0f6f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:17:09.904536 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (efa4e9ae-90ed-49ad-9b00-bcd07a0f6f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a69bbe9e-0481-45eb-807a-0a14799fc07b),volume_id=a69bbe9e-0481-45eb-807a-0a14799fc07b,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:17:09.910872 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5b18407e-e245-4529-96cc-48367610b9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:17:09.934921 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:17:10.038015 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 7, 23, 21, 16, 10, 122217)} {{(pid=123551) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Jul 23 21:17:10.040084 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Starting with 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:17:10.040860 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:17:10.042198 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (a69bbe9e-0481-45eb-807a-0a14799fc07b) {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Jul 23 21:17:10.043300 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 0, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 0, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:16:10.122217 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Jul 23 21:17:10.044825 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/398.8 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Jul 23 21:17:10.045398 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Filter CapacityFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:17:10.049211 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:17:10.054379 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 0, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 0, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:16:10.122217] {{(pid=123551) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Jul 23 21:17:10.055468 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_weight [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Weigher CapacityWeigher returned, weigher value is {max: 398.8, min: 398.8} {{(pid=123551) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Jul 23 21:17:10.055998 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=123551) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Jul 23 21:17:10.056727 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Choosing ncdv-master-1@ceph#ceph {{(pid=123551) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Jul 23 21:17:10.064417 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:17:10.056756 {{(pid=123551) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Jul 23 21:17:10.435862 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-5540e3bd-c287-4fd6-8297-e326d0370591 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:17:10.471395 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5b18407e-e245-4529-96cc-48367610b9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:17:10.488001 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ad0b49c4-66fa-4b6b-a56e-a2b4a761ff39 tempest-LiveMigrationTest-731745934 None] Flow 'volume_create_scheduler' (367cb602-d87c-4389-823d-c65b7159d996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:17:12.630748 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=22,cinder:UPDATE=5 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:37.063039 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Flow 'volume_create_scheduler' (cb022c75-868f-4b63-b584-c0509ef506e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:17:37.068568 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3efab02f-2835-4b26-938f-3ac9b02fa02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:17:37.073104 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3efab02f-2835-4b26-938f-3ac9b02fa02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ae9e1d9d-8480-46b5-b3ec-f6bb2a5341c9),volume_id=ae9e1d9d-8480-46b5-b3ec-f6bb2a5341c9,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:17:37.076768 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7cf128c9-825d-4fbb-a92d-bc27058b1506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:17:37.091148 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:17:37.108173 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 7, 23, 21, 17, 10, 199203)} {{(pid=123551) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Jul 23 21:17:37.108872 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Starting with 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:17:37.109444 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:17:37.109981 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (ae9e1d9d-8480-46b5-b3ec-f6bb2a5341c9) {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Jul 23 21:17:37.110658 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 0, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 0, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:17:10.199203 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Jul 23 21:17:37.111208 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/398.8 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Jul 23 21:17:37.111703 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Filter CapacityFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:17:37.112225 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:17:37.112735 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 0, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 0, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:17:10.199203] {{(pid=123551) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Jul 23 21:17:37.113450 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_weight [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Weigher CapacityWeigher returned, weigher value is {max: 398.8, min: 398.8} {{(pid=123551) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Jul 23 21:17:37.113977 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=123551) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Jul 23 21:17:37.123908 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Choosing ncdv-master-1@ceph#ceph {{(pid=123551) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Jul 23 21:17:37.124578 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:17:37.124168 {{(pid=123551) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Jul 23 21:17:37.177631 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7cf128c9-825d-4fbb-a92d-bc27058b1506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:17:37.182168 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-edfbc937-c2cf-4d52-8003-6b0ad4370335 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Flow 'volume_create_scheduler' (cb022c75-868f-4b63-b584-c0509ef506e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:17:52.624908 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=6,cinder:SELECT=21 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:07.509223 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-f65a2f1d-c783-4c35-ba5a-a740d5705e49 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:18:09.386910 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Flow 'volume_create_scheduler' (40c2dc83-5ea5-414b-b2af-aeba2a6ecf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:18:09.403334 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0040e1e2-e24d-434c-bfe1-a0bc8edd9cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:18:09.427658 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0040e1e2-e24d-434c-bfe1-a0bc8edd9cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b27b20aa-ef1b-4dd1-989e-321af6343d6a,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(67709f74-c94d-4ce5-9fc8-64292fc105a9),volume_id=67709f74-c94d-4ce5-9fc8-64292fc105a9,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:18:09.447866 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e751c141-5b2b-4827-9e8f-bf9b1f331f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:18:09.476224 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:18:09.543735 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 7, 23, 21, 17, 10, 199203)} {{(pid=123551) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Jul 23 21:18:09.546963 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Starting with 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:18:09.550172 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:18:09.552446 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (67709f74-c94d-4ce5-9fc8-64292fc105a9) {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Jul 23 21:18:09.554994 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:17:37.124168 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Jul 23 21:18:09.556144 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/378.8 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Jul 23 21:18:09.559327 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Filter CapacityFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:18:09.563084 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:18:09.563713 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:17:37.124168] {{(pid=123551) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Jul 23 21:18:09.565734 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_weight [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Weigher CapacityWeigher returned, weigher value is {max: 397.8, min: 397.8} {{(pid=123551) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Jul 23 21:18:09.568797 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=123551) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Jul 23 21:18:09.571089 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Choosing ncdv-master-1@ceph#ceph {{(pid=123551) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Jul 23 21:18:09.573383 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.94, total_capacity_gb: 19.94, allocated_capacity_gb: 2, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:18:09.572449 {{(pid=123551) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Jul 23 21:18:09.713307 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e751c141-5b2b-4827-9e8f-bf9b1f331f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:18:09.724922 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-42ead23f-64fc-4368-9ec0-d77ef7625598 tempest-LiveMigrationTest-731745934 None] Flow 'volume_create_scheduler' (40c2dc83-5ea5-414b-b2af-aeba2a6ecf40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:18:10.162805 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-6295daa2-d437-4a53-b523-c0744457764d None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:18:29.496340 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:29.572873 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Flow 'volume_create_scheduler' (70b0bd99-8cf9-488a-a899-a1deb5684507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:18:29.580092 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5fa5852a-3dfd-44d9-b8ac-38c940b28369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:18:29.603112 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5fa5852a-3dfd-44d9-b8ac-38c940b28369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b27b20aa-ef1b-4dd1-989e-321af6343d6a,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(45722d72-c3a2-4f78-9923-e1cce3fffdf2),volume_id=45722d72-c3a2-4f78-9923-e1cce3fffdf2,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:18:29.609674 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e373d774-e3d8-40e8-9e2a-8ef7292fc22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:18:29.634950 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:18:29.667257 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 7, 23, 21, 18, 10, 157894)} {{(pid=123551) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Jul 23 21:18:29.667684 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Starting with 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:18:29.668072 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:18:29.668395 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (45722d72-c3a2-4f78-9923-e1cce3fffdf2) {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Jul 23 21:18:29.668802 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:18:10.157894 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Jul 23 21:18:29.669131 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/398.8 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Jul 23 21:18:29.669469 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Filter CapacityFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:18:29.669848 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:18:29.670236 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:18:10.157894] {{(pid=123551) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Jul 23 21:18:29.670647 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_weight [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Weigher CapacityWeigher returned, weigher value is {max: 395.8, min: 395.8} {{(pid=123551) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Jul 23 21:18:29.670988 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=123551) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Jul 23 21:18:29.671455 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Choosing ncdv-master-1@ceph#ceph {{(pid=123551) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Jul 23 21:18:29.671830 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:18:29.671484 {{(pid=123551) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Jul 23 21:18:29.746327 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e373d774-e3d8-40e8-9e2a-8ef7292fc22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:18:29.755278 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-be644e03-4508-4e3b-9c2e-b687217b6ed5 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Flow 'volume_create_scheduler' (70b0bd99-8cf9-488a-a899-a1deb5684507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:18:59.632957 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Flow 'volume_create_scheduler' (1788f31e-aa1e-422a-bf80-a7a58aaacc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:18:59.644128 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (957deae4-6a0e-43d9-98d1-d18fabf4afd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:18:59.660410 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (957deae4-6a0e-43d9-98d1-d18fabf4afd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8a819a79-2619-464d-a96a-b3a49144bb57),volume_id=8a819a79-2619-464d-a96a-b3a49144bb57,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:18:59.669807 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9d776479-541b-4ce0-b1b8-0e0e6ec91128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:18:59.687713 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:18:59.695303 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:59.709133 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 7, 23, 21, 18, 10, 157894)} {{(pid=123551) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Jul 23 21:18:59.709830 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Starting with 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:18:59.710883 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:18:59.711412 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (8a819a79-2619-464d-a96a-b3a49144bb57) {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Jul 23 21:18:59.712076 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:18:29.671484 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Jul 23 21:18:59.712577 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/378.8 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Jul 23 21:18:59.713214 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Filter CapacityFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:18:59.713749 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:18:59.714375 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:18:29.671484] {{(pid=123551) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Jul 23 21:18:59.714991 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_weight [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Weigher CapacityWeigher returned, weigher value is {max: 394.8, min: 394.8} {{(pid=123551) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Jul 23 21:18:59.715560 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=123551) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Jul 23 21:18:59.716264 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Choosing ncdv-master-1@ceph#ceph {{(pid=123551) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Jul 23 21:18:59.717506 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.94, total_capacity_gb: 19.94, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:18:59.716468 {{(pid=123551) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Jul 23 21:18:59.764656 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9d776479-541b-4ce0-b1b8-0e0e6ec91128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:18:59.770206 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5cd1fd5a-446f-4897-b408-484a3e4e9efe tempest-AttachSCSIVolumeTestJSON-683239709 None] Flow 'volume_create_scheduler' (1788f31e-aa1e-422a-bf80-a7a58aaacc22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:19:07.504727 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-ffb4750f-e72d-4f1d-baeb-0f2de7b7d25f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:19:10.292625 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-1ae83063-273e-4a5f-924b-58b023afa29f None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.5, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 6, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:19:20.680846 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Flow 'volume_create_scheduler' (9ba56f52-2056-42a1-b60d-18bfc66999ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:19:20.693678 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4b5db053-bea7-4787-8544-01d5164e57e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:19:20.703039 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4b5db053-bea7-4787-8544-01d5164e57e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b27b20aa-ef1b-4dd1-989e-321af6343d6a,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(45847d66-e6fb-4802-888a-09b3751e9a66),volume_id=45847d66-e6fb-4802-888a-09b3751e9a66,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:19:20.722771 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ccb3fe3e-782d-455f-bf53-fe30b3543cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:19:20.762004 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:19:20.781355 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.5, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 6, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 7, 23, 21, 19, 10, 286859)} {{(pid=123551) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Jul 23 21:19:20.781894 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Starting with 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:19:20.782134 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:19:20.782486 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (45847d66-e6fb-4802-888a-09b3751e9a66) {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Jul 23 21:19:20.782883 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.5, total_capacity_gb: 19.94, allocated_capacity_gb: 6, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 6, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:19:10.286859 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Jul 23 21:19:20.783286 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/390.0 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Jul 23 21:19:20.783592 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Filter CapacityFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:19:20.783966 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:19:20.784325 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.5, total_capacity_gb: 19.94, allocated_capacity_gb: 6, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 6, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:19:10.286859] {{(pid=123551) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Jul 23 21:19:20.784741 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_weight [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Weigher CapacityWeigher returned, weigher value is {max: 392.8, min: 392.8} {{(pid=123551) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Jul 23 21:19:20.785051 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=123551) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Jul 23 21:19:20.785516 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Choosing ncdv-master-1@ceph#ceph {{(pid=123551) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Jul 23 21:19:20.785892 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.5, total_capacity_gb: 19.94, allocated_capacity_gb: 7, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 7, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:19:20.785540 {{(pid=123551) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Jul 23 21:19:20.860127 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ccb3fe3e-782d-455f-bf53-fe30b3543cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:19:20.867684 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-48681d40-84c5-49f1-a084-4255fab983c1 tempest-TaggedBootDevicesTest_v242-1302726931 None] Flow 'volume_create_scheduler' (9ba56f52-2056-42a1-b60d-18bfc66999ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:19:23.378976 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Flow 'volume_create_scheduler' (62e3177d-2568-420a-948b-ca3408bb9695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:19:23.384613 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (64f94867-00c3-4985-b282-331063fb12cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:19:23.398985 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (64f94867-00c3-4985-b282-331063fb12cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(d1dcd2ad-1f42-4cd4-ae7b-4f9ec30b5094),volume_id=d1dcd2ad-1f42-4cd4-ae7b-4f9ec30b5094,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:19:23.403572 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b5305fce-822b-41c1-aaac-982735edd24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:19:23.423417 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:19:23.442632 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.5, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 6, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 7, 23, 21, 19, 10, 286859)} {{(pid=123551) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Jul 23 21:19:23.443365 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Starting with 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:19:23.443942 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:19:23.444496 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (d1dcd2ad-1f42-4cd4-ae7b-4f9ec30b5094) {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Jul 23 21:19:23.445079 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.5, total_capacity_gb: 19.94, allocated_capacity_gb: 7, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 7, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:19:20.785540 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Jul 23 21:19:23.445621 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/370.0 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Jul 23 21:19:23.446302 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Filter CapacityFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:19:23.447195 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:19:23.447950 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.5, total_capacity_gb: 19.94, allocated_capacity_gb: 7, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 7, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:19:20.785540] {{(pid=123551) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Jul 23 21:19:23.448564 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_weight [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Weigher CapacityWeigher returned, weigher value is {max: 391.8, min: 391.8} {{(pid=123551) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Jul 23 21:19:23.449088 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=123551) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Jul 23 21:19:23.449767 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Choosing ncdv-master-1@ceph#ceph {{(pid=123551) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Jul 23 21:19:23.450369 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.5, total_capacity_gb: 19.94, allocated_capacity_gb: 8, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 8, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:19:23.450013 {{(pid=123551) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Jul 23 21:19:23.496730 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b5305fce-822b-41c1-aaac-982735edd24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:19:23.504798 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6f5e1749-357c-4ca6-9482-006d160dc0df tempest-TaggedBootDevicesTest_v242-1302726931 None] Flow 'volume_create_scheduler' (62e3177d-2568-420a-948b-ca3408bb9695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:19:25.135176 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Flow 'volume_create_scheduler' (7d365b1c-d827-4e6c-875d-7cfcd5f28eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:19:25.152696 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f9b7db21-b48c-4808-8dc6-3fc673e831f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:19:25.161123 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f9b7db21-b48c-4808-8dc6-3fc673e831f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(05a64e2b-5dee-45e2-80f3-6e3860844946),volume_id=05a64e2b-5dee-45e2-80f3-6e3860844946,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:19:25.176060 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9bf45c4e-fe19-4022-ba1d-60a22cd3e7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:19:25.185732 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:19:25.228232 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.5, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 6, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 7, 23, 21, 19, 10, 286859)} {{(pid=123551) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Jul 23 21:19:25.228766 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Starting with 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:19:25.229134 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:19:25.229493 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (05a64e2b-5dee-45e2-80f3-6e3860844946) {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Jul 23 21:19:25.229952 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.5, total_capacity_gb: 19.94, allocated_capacity_gb: 8, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 8, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:19:23.450013 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Jul 23 21:19:25.230325 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/350.0 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Jul 23 21:19:25.230665 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Filter CapacityFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:19:25.231046 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:19:25.231409 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.5, total_capacity_gb: 19.94, allocated_capacity_gb: 8, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 8, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:19:23.450013] {{(pid=123551) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Jul 23 21:19:25.231823 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_weight [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Weigher CapacityWeigher returned, weigher value is {max: 390.8, min: 390.8} {{(pid=123551) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Jul 23 21:19:25.232175 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=123551) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Jul 23 21:19:25.232647 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Choosing ncdv-master-1@ceph#ceph {{(pid=123551) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Jul 23 21:19:25.233023 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 16.5, total_capacity_gb: 19.94, allocated_capacity_gb: 9, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 9, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:19:25.232673 {{(pid=123551) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Jul 23 21:19:25.276933 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9bf45c4e-fe19-4022-ba1d-60a22cd3e7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:19:25.288034 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-f888cb86-c815-4fb7-a300-ab06b887e167 tempest-TaggedBootDevicesTest_v242-1302726931 None] Flow 'volume_create_scheduler' (7d365b1c-d827-4e6c-875d-7cfcd5f28eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:19:29.588086 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-5ce4d82a-469d-4e65-995b-90e49e7fa153 tempest-AttachSCSIVolumeTestJSON-683239709 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.5, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 8, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:19:32.629333 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=50,cinder:UPDATE=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:07.503836 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-d06a943d-7acb-42b5-b109-2a9dc1e619de None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:20:10.151327 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-eb641488-08bf-43e9-af80-453b6665ccac None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.45, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 8, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:20:11.693742 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [req-f6106aa0-65f5-424e-9d3c-a0e14c7e59d2 req-757c2f7a-4955-4f74-970a-1a852a880881 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.44, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 7, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:20:12.633043 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:13.151234 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [req-afaf8eff-62e6-451f-b83e-a560a142656c req-3fe153d5-806c-4fbc-9c70-c642897e8701 tempest-LiveMigrationTest-731745934 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.44, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 6, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:20:13.402242 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-83c89656-c18a-4b68-9053-98c8a084a847 tempest-LiveAutoBlockMigrationV225Test-2065000324 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.44, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 5, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:20:15.075190 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-29fd9805-bdb2-42e9-a2b0-a4e1701e76c4 tempest-LiveMigrationTest-731745934 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.44, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 4, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:20:19.267166 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Flow 'volume_create_scheduler' (7d97368e-1023-4dba-aa65-88f67d6bc1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:20:19.277322 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8777fece-e9ac-4f59-b291-ed58c78f13c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:20:19.290799 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8777fece-e9ac-4f59-b291-ed58c78f13c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(0f7a6529-1334-4899-b7cd-f77b9a726980),volume_id=0f7a6529-1334-4899-b7cd-f77b9a726980,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:20:19.301200 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (047010fb-aee3-44f2-a5bf-cbdb642c894f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:20:19.333398 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:20:19.363941 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.44, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 4, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 7, 23, 21, 20, 15, 58626)} {{(pid=123551) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Jul 23 21:20:19.364342 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Starting with 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:20:19.364691 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:20:19.365221 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (0f7a6529-1334-4899-b7cd-f77b9a726980) {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Jul 23 21:20:19.365785 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.44, total_capacity_gb: 19.93, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:20:15.058626 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Jul 23 21:20:19.366331 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/388.8 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Jul 23 21:20:19.366850 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Filter CapacityFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:20:19.367411 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:20:19.367928 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.44, total_capacity_gb: 19.93, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:20:15.058626] {{(pid=123551) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Jul 23 21:20:19.369199 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_weight [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Weigher CapacityWeigher returned, weigher value is {max: 394.6, min: 394.6} {{(pid=123551) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Jul 23 21:20:19.369705 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=123551) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Jul 23 21:20:19.371836 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Choosing ncdv-master-1@ceph#ceph {{(pid=123551) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Jul 23 21:20:19.372405 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.44, total_capacity_gb: 19.93, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:20:19.372044 {{(pid=123551) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Jul 23 21:20:19.431426 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (047010fb-aee3-44f2-a5bf-cbdb642c894f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:20:19.440367 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-424e4a34-fae1-43b4-81f5-73e4b0c58630 tempest-VolumesAdminNegativeTest-1859024807 None] Flow 'volume_create_scheduler' (7d97368e-1023-4dba-aa65-88f67d6bc1d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:20:51.471305 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:51.540833 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Flow 'volume_create_scheduler' (c153d808-4164-4718-ae79-c7cac4200248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:20:51.554274 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (17b38965-2bc8-40a2-a554-dfd0cf00c3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:20:51.563109 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (17b38965-2bc8-40a2-a554-dfd0cf00c3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(716a9d6f-b654-4f69-8193-47039140b86e),volume_id=716a9d6f-b654-4f69-8193-47039140b86e,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:20:51.574770 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ba1409d5-6959-4a2d-b4d8-d3ee0767ea3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:20:51.595645 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:20:51.650980 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.44, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 4, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 7, 23, 21, 20, 15, 58626)} {{(pid=123551) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Jul 23 21:20:51.656104 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Starting with 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:20:51.656719 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:20:51.657523 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (716a9d6f-b654-4f69-8193-47039140b86e) {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Jul 23 21:20:51.658173 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.44, total_capacity_gb: 19.93, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:20:19.372044 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Jul 23 21:20:51.659089 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/368.8 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Jul 23 21:20:51.659629 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Filter CapacityFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:20:51.660194 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:20:51.660752 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.44, total_capacity_gb: 19.93, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:20:19.372044] {{(pid=123551) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Jul 23 21:20:51.661385 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_weight [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Weigher CapacityWeigher returned, weigher value is {max: 393.6, min: 393.6} {{(pid=123551) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Jul 23 21:20:51.661934 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=123551) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Jul 23 21:20:51.662629 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Choosing ncdv-master-1@ceph#ceph {{(pid=123551) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Jul 23 21:20:51.663201 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.44, total_capacity_gb: 19.93, allocated_capacity_gb: 6, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 6, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:20:51.662849 {{(pid=123551) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Jul 23 21:20:51.712575 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ba1409d5-6959-4a2d-b4d8-d3ee0767ea3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:20:51.719706 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-fa1bf053-382f-4000-9869-3c89f32478e4 tempest-VolumesAdminNegativeTest-1859024807 None] Flow 'volume_create_scheduler' (c153d808-4164-4718-ae79-c7cac4200248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:20:54.034726 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-e50e20dc-96d4-4ee1-a73c-4ea2832481ef tempest-VolumesAdminNegativeTest-1859024807 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.48, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 5, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:21:02.620238 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-8cf665a5-a5dc-4d91-878b-5f384ea40349 tempest-VolumesAdminNegativeTest-1859024807 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.48, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 4, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:21:07.506084 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-3784dcd6-1e04-4cf3-982b-44bccfc6c038 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:21:10.140813 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-f3334f2a-a4f4-439b-89b1-73f6283e5983 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.48, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 4, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:21:22.632157 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:02.636690 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:07.509732 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-f7eb186f-4dfc-456e-982d-87cb009ba178 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:22:10.180346 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-9996cf5d-e0c6-4c54-8759-7be0c89a8511 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.91, 'free_capacity_gb': 19.42, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 4, 'filter_function': None, 'goodness_function': None} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Jul 23 21:22:18.078724 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Flow 'volume_create_scheduler' (a2bab098-95a6-4106-809b-f7822b911ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:22:18.104721 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (31b07065-6617-45fa-a95e-1cae192d5ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:22:18.124218 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (31b07065-6617-45fa-a95e-1cae192d5ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b27b20aa-ef1b-4dd1-989e-321af6343d6a,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(76b79c8c-15ff-4ad6-ac7f-aed13c36dfc1),volume_id=76b79c8c-15ff-4ad6-ac7f-aed13c36dfc1,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:22:18.144199 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (26644df4-54a5-4387-8292-f75940ef82a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:22:18.184377 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:22:18.239952 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.91, 'free_capacity_gb': 19.42, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:23f8b133-f93c-4388-abba-5d8e47858b41:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 4, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 7, 23, 21, 22, 10, 174865)} {{(pid=123551) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Jul 23 21:22:18.241598 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Starting with 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:22:18.243331 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:22:18.249231 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (76b79c8c-15ff-4ad6-ac7f-aed13c36dfc1) {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Jul 23 21:22:18.254491 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.42, total_capacity_gb: 19.91, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:22:10.174865 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Jul 23 21:22:18.257352 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filters.capacity_filter [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/388.40000000000003 {{(pid=123551) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Jul 23 21:22:18.257784 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Filter CapacityFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:22:18.258377 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:22:18.259908 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.42, total_capacity_gb: 19.91, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:22:10.174865] {{(pid=123551) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Jul 23 21:22:18.262551 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_weight [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Weigher CapacityWeigher returned, weigher value is {max: 394.2, min: 394.2} {{(pid=123551) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Jul 23 21:22:18.264206 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=123551) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Jul 23 21:22:18.268168 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.filter_scheduler [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Choosing ncdv-master-1@ceph#ceph {{(pid=123551) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Jul 23 21:22:18.268820 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.42, total_capacity_gb: 19.91, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-07-23 21:22:18.268435 {{(pid=123551) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Jul 23 21:22:18.387098 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (26644df4-54a5-4387-8292-f75940ef82a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:22:18.399796 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-082a43b9-6817-4ade-82d2-4964ccaf74f5 tempest-ServersTestBootFromVolume-253143402 None] Flow 'volume_create_scheduler' (a2bab098-95a6-4106-809b-f7822b911ad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:22:42.647322 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:07.504963 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-18309a76-fd1d-4a71-8956-73193711580e None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:23:22.656582 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:02.657483 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:07.505479 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-0cf2bc62-0b4e-4fee-ad80-0fc744d0ce30 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:24:42.657895 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:07.504735 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-70bc8077-2ab5-420e-9009-c4cab1a3e249 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:25:22.649526 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:02.658626 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:07.513143 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-ad2c1285-b786-4cd4-be2c-8dfa8eda541e None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:26:30.636502 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Flow 'volume_create_scheduler' (66717b10-ec5f-4859-a5a8-490e7146a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:26:30.642543 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3c98c314-4835-4b64-9514-0e78b1374469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:26:30.647690 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3c98c314-4835-4b64-9514-0e78b1374469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(02f286ce-2510-4f9c-bb55-f9ddec678298),volume_id=02f286ce-2510-4f9c-bb55-f9ddec678298,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:26:30.652026 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (892b32cd-70ef-41ba-97b7-9a6beccb5dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:26:30.663541 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:26:30.682884 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:26:30.683396 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.host_manager [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Removing non-active backend: ncdv-master-1@ceph from scheduler cache. Jul 23 21:26:30.685033 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:26:30.685486 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:26:30.685926 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:26:30.686328 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:26:30.687017 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Filtering removed all hosts for the request with volume ID '02f286ce-2510-4f9c-bb55-f9ddec678298'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:26:30.687523 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Filtering removed all hosts for the request with volume ID '02f286ce-2510-4f9c-bb55-f9ddec678298'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:26:30.688348 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:26:30.688824 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Creating message record for request_id = req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 Jul 23 21:26:30.706994 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:26:30.707384 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Setting Volume 02f286ce-2510-4f9c-bb55-f9ddec678298 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:26:30.730975 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (892b32cd-70ef-41ba-97b7-9a6beccb5dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:26:30.734274 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-17ac10c3-f6e7-46b5-895f-b7bbe27a73c5 tempest-DeleteServersTestJSON-745069838 None] Flow 'volume_create_scheduler' (66717b10-ec5f-4859-a5a8-490e7146a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:26:42.654015 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:07.514666 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-ffa0d719-e4e9-4086-a873-9ce0d6a448dd None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:27:22.665012 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:02.655581 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:07.514073 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-c45e906e-49a7-4593-a208-3a39b7da0575 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:28:16.098244 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] Flow 'volume_create_scheduler' (204637b8-4cd4-440d-bbdb-cac0ad1f10d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:28:16.103606 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (51cedfda-7f8b-4a63-aeb3-71c4e06e58ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:28:16.108802 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (51cedfda-7f8b-4a63-aeb3-71c4e06e58ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(6cfe4f08-8710-4953-8204-c1682951a821),volume_id=6cfe4f08-8710-4953-8204-c1682951a821,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:28:16.113582 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3780f1eb-3e46-491e-96af-79c243609589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:28:16.123858 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:28:16.143077 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:28:16.143846 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:28:16.144610 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:28:16.145232 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:28:16.145813 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:28:16.146903 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] Filtering removed all hosts for the request with volume ID '6cfe4f08-8710-4953-8204-c1682951a821'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:28:16.147772 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] Filtering removed all hosts for the request with volume ID '6cfe4f08-8710-4953-8204-c1682951a821'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:28:16.148656 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:28:16.149438 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] Creating message record for request_id = req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 Jul 23 21:28:16.176944 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:28:16.178930 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] Setting Volume 6cfe4f08-8710-4953-8204-c1682951a821 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:28:16.198529 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3780f1eb-3e46-491e-96af-79c243609589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:28:16.205084 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-a7038580-92fd-475a-9f36-6a8c5a9fdfa3 tempest-ServerRescueNegativeTestJSON-2128176625 None] Flow 'volume_create_scheduler' (204637b8-4cd4-440d-bbdb-cac0ad1f10d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:28:17.712624 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] Flow 'volume_create_scheduler' (11954c7e-b823-4936-948b-c213635b02e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:28:17.716821 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (87138038-efd5-40c5-a396-a871935f09d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:28:17.737991 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (87138038-efd5-40c5-a396-a871935f09d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a1d2d050-42d6-4b3e-bad3-a329af978366),volume_id=a1d2d050-42d6-4b3e-bad3-a329af978366,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:28:17.741426 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ae2674b5-5de4-43ba-b35c-981a8e6e1318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:28:17.761660 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:28:17.815632 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:28:17.816226 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:28:17.816668 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:28:17.841186 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:28:17.841980 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:28:17.843434 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] Filtering removed all hosts for the request with volume ID 'a1d2d050-42d6-4b3e-bad3-a329af978366'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:28:17.844610 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] Filtering removed all hosts for the request with volume ID 'a1d2d050-42d6-4b3e-bad3-a329af978366'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:28:17.846109 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:28:17.846860 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] Creating message record for request_id = req-7aaf73da-8725-4c24-b251-51eb1b1524b0 Jul 23 21:28:17.868738 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:28:17.869575 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] Setting Volume a1d2d050-42d6-4b3e-bad3-a329af978366 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:28:17.904699 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ae2674b5-5de4-43ba-b35c-981a8e6e1318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:28:17.909470 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-7aaf73da-8725-4c24-b251-51eb1b1524b0 tempest-ServerRescueNegativeTestJSON-2128176625 None] Flow 'volume_create_scheduler' (11954c7e-b823-4936-948b-c213635b02e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:28:42.655824 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=34,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:07.489365 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] Flow 'volume_create_scheduler' (bcd59bd4-f941-43a4-b79c-1169a369e525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:29:07.503600 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5960f9a8-d833-41b9-a3dc-057b2ae28ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:29:07.515635 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5960f9a8-d833-41b9-a3dc-057b2ae28ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(13c24739-e27c-4921-8ad2-84cccb05f83e),volume_id=13c24739-e27c-4921-8ad2-84cccb05f83e,volume_properties=VolumeProperties,volume_type=VolumeType(e706ef46-23d0-44d5-9e80-a111cea31619))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:29:07.533530 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4bd27174-e388-4ba2-88b0-e203655ab21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:29:07.554037 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:29:07.577789 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-3c09e3ec-9f86-4b3e-ab6c-b5b082aebc15 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:29:07.580223 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:29:07.580587 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:29:07.580987 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:29:07.581338 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:29:07.581679 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:29:07.582053 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] Filtering removed all hosts for the request with volume ID '13c24739-e27c-4921-8ad2-84cccb05f83e'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:29:07.582811 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] Filtering removed all hosts for the request with volume ID '13c24739-e27c-4921-8ad2-84cccb05f83e'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:29:07.583487 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] No weighed backend found for volume with properties: {'id': 'e706ef46-23d0-44d5-9e80-a111cea31619', 'name': 'tempest-UserMessagesTest-volume-type-1890279177', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'storage_protocol': 'tempest-storage_protocol-555048851', 'vendor_name': 'tempest-vendor_name-1139524986'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:29:06.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:29:07.584088 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] Creating message record for request_id = req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 Jul 23 21:29:07.599770 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:29:07.600537 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] Setting Volume 13c24739-e27c-4921-8ad2-84cccb05f83e to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:29:07.621499 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4bd27174-e388-4ba2-88b0-e203655ab21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:29:07.627760 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5810f9bf-2224-4ec0-bee1-d3f794a71cd3 tempest-UserMessagesTest-664386919 None] Flow 'volume_create_scheduler' (bcd59bd4-f941-43a4-b79c-1169a369e525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:29:09.543136 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] Flow 'volume_create_scheduler' (13a9033f-7cff-4212-a1fa-37c0ea5d3ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:29:09.575908 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (067f9412-36bd-496f-9530-c776354470bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:29:09.585440 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (067f9412-36bd-496f-9530-c776354470bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(71c7504e-1506-402d-996d-33b3cd0ae595),volume_id=71c7504e-1506-402d-996d-33b3cd0ae595,volume_properties=VolumeProperties,volume_type=VolumeType(ca2c65ee-e054-4a7d-acaa-c00d56470035))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:29:09.594106 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8a75d4dd-5b80-41b3-93a9-3f11a747f4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:29:09.616606 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:29:09.637226 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:29:09.637515 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:29:09.639145 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:29:09.639887 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:29:09.640430 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:29:09.653755 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] Filtering removed all hosts for the request with volume ID '71c7504e-1506-402d-996d-33b3cd0ae595'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:29:09.654804 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] Filtering removed all hosts for the request with volume ID '71c7504e-1506-402d-996d-33b3cd0ae595'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:29:09.656653 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] No weighed backend found for volume with properties: {'id': 'ca2c65ee-e054-4a7d-acaa-c00d56470035', 'name': 'tempest-UserMessagesTest-volume-type-452459507', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'storage_protocol': 'tempest-storage_protocol-1542813105', 'vendor_name': 'tempest-vendor_name-528573435'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:29:09.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:29:09.659693 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] Creating message record for request_id = req-6efa315a-ecdf-4261-afb9-583f2ee636e5 Jul 23 21:29:09.676584 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:29:09.679119 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] Setting Volume 71c7504e-1506-402d-996d-33b3cd0ae595 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:29:09.705545 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8a75d4dd-5b80-41b3-93a9-3f11a747f4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:29:09.712101 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6efa315a-ecdf-4261-afb9-583f2ee636e5 tempest-UserMessagesTest-664386919 None] Flow 'volume_create_scheduler' (13a9033f-7cff-4212-a1fa-37c0ea5d3ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:29:18.142141 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=34,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:18.146949 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-301d8e42-477e-4443-984e-112ae4b96427 tempest-VolumePoolsAdminTestsJSON-2047452838 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:29:18.226028 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-718f122d-af49-4e35-bce9-fd31c8e4282f tempest-VolumePoolsAdminTestsJSON-2047452838 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:29:26.797824 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] Flow 'volume_create_scheduler' (44ccd574-cd23-4acd-b671-bc2a6dd8d89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:29:26.813186 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5523413a-cb82-4dab-ad7e-e3cff252b5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:29:26.819291 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5523413a-cb82-4dab-ad7e-e3cff252b5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(336c3345-eee6-478b-99c0-d054b8ab3857),volume_id=336c3345-eee6-478b-99c0-d054b8ab3857,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:29:26.830194 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f2cf3675-8cab-423b-a797-89eccfa4cfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:29:26.853593 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:29:26.881276 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:29:26.883899 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:29:26.884481 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:29:26.885004 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:29:26.885521 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:29:26.886173 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] Filtering removed all hosts for the request with volume ID '336c3345-eee6-478b-99c0-d054b8ab3857'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:29:26.886678 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] Filtering removed all hosts for the request with volume ID '336c3345-eee6-478b-99c0-d054b8ab3857'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:29:26.887342 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:29:26.888751 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] Creating message record for request_id = req-05b96f73-9ecc-4287-9030-f32adb4494ea Jul 23 21:29:26.899895 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:29:26.900595 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] Setting Volume 336c3345-eee6-478b-99c0-d054b8ab3857 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:29:26.931674 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f2cf3675-8cab-423b-a797-89eccfa4cfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:29:26.942391 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-05b96f73-9ecc-4287-9030-f32adb4494ea tempest-VolumesServicesTestJSON-1435145283 None] Flow 'volume_create_scheduler' (44ccd574-cd23-4acd-b671-bc2a6dd8d89a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:29:52.548647 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=24,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:52.586383 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] Flow 'volume_create_scheduler' (640bced6-5fef-4bb9-8597-1e2bbb4ac42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:29:52.606382 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8f2ab603-93e6-4392-b60e-a6dc8bb7f936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:29:52.611107 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8f2ab603-93e6-4392-b60e-a6dc8bb7f936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(96452321-aae0-4564-a740-a3c436c53991),volume_id=96452321-aae0-4564-a740-a3c436c53991,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:29:52.618870 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6b584497-6b30-48e5-991e-f363c22096df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:29:52.630964 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:29:52.649837 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:29:52.650477 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:29:52.650828 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:29:52.651166 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:29:52.651666 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:29:52.652139 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] Filtering removed all hosts for the request with volume ID '96452321-aae0-4564-a740-a3c436c53991'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:29:52.652609 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] Filtering removed all hosts for the request with volume ID '96452321-aae0-4564-a740-a3c436c53991'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:29:52.653790 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:29:52.654410 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] Creating message record for request_id = req-d8a44a4b-59c9-49d6-b026-6da051f41288 Jul 23 21:29:52.665266 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:29:52.665808 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] Setting Volume 96452321-aae0-4564-a740-a3c436c53991 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:29:52.684137 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6b584497-6b30-48e5-991e-f363c22096df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:29:52.687840 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d8a44a4b-59c9-49d6-b026-6da051f41288 tempest-VolumesBackupsAdminTest-778215865 None] Flow 'volume_create_scheduler' (640bced6-5fef-4bb9-8597-1e2bbb4ac42a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:29:54.081717 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] Flow 'volume_create_scheduler' (8e306cc4-e94e-43e3-b862-fb1362656a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:29:54.097785 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f2b7dcd6-4488-4adb-87ed-cb31a5bdff3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:29:54.104787 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f2b7dcd6-4488-4adb-87ed-cb31a5bdff3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(1bc413bd-f365-4bc6-9a8b-2db38153ccb3),volume_id=1bc413bd-f365-4bc6-9a8b-2db38153ccb3,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:29:54.114382 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (97d6a6af-f6dd-4485-a399-dd4cbecee0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:29:54.131971 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:29:54.152734 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:29:54.153504 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:29:54.154337 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:29:54.154885 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:29:54.155540 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:29:54.156431 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] Filtering removed all hosts for the request with volume ID '1bc413bd-f365-4bc6-9a8b-2db38153ccb3'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:29:54.157031 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] Filtering removed all hosts for the request with volume ID '1bc413bd-f365-4bc6-9a8b-2db38153ccb3'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:29:54.157975 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:29:54.158736 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] Creating message record for request_id = req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 Jul 23 21:29:54.174235 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:29:54.174708 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] Setting Volume 1bc413bd-f365-4bc6-9a8b-2db38153ccb3 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:29:54.187058 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (97d6a6af-f6dd-4485-a399-dd4cbecee0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:29:54.199549 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dfc4c081-278d-4eab-90c0-e50c4d1b73a4 tempest-VolumesBackupsAdminTest-778215865 None] Flow 'volume_create_scheduler' (8e306cc4-e94e-43e3-b862-fb1362656a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:30:04.352080 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] Flow 'volume_create_scheduler' (b56d56da-2675-45bb-9a53-b218a8c8033d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:30:04.361777 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a387d967-061c-4640-a563-4e5db14bd65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:30:04.369190 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a387d967-061c-4640-a563-4e5db14bd65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(922431d1-f33a-4730-98e4-dfd163b5e4cc),volume_id=922431d1-f33a-4730-98e4-dfd163b5e4cc,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:30:04.373694 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (67e3bedc-1402-439d-aad5-0453f7f8b5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:30:04.383167 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:30:04.412723 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:30:04.413456 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:30:04.427057 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:04.427774 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:04.431133 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:04.431616 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] Filtering removed all hosts for the request with volume ID '922431d1-f33a-4730-98e4-dfd163b5e4cc'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:30:04.432068 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] Filtering removed all hosts for the request with volume ID '922431d1-f33a-4730-98e4-dfd163b5e4cc'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:30:04.433339 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:30:04.433891 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] Creating message record for request_id = req-70b12afb-05e9-4522-ba69-477604b4f61a Jul 23 21:30:04.459139 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:30:04.459718 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] Setting Volume 922431d1-f33a-4730-98e4-dfd163b5e4cc to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:30:04.479749 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (67e3bedc-1402-439d-aad5-0453f7f8b5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:30:04.484667 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-70b12afb-05e9-4522-ba69-477604b4f61a tempest-VolumesListAdminTestJSON-1660986817 None] Flow 'volume_create_scheduler' (b56d56da-2675-45bb-9a53-b218a8c8033d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:30:07.519291 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-d6e08f03-f549-4f9b-abbf-0b53ec5e54f1 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:30:16.768830 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] Flow 'volume_create_scheduler' (343aab59-9f6f-4722-831e-785d51ddaa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:30:16.782826 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1c577e07-12da-4374-b648-f4f659039fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:30:16.831146 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1c577e07-12da-4374-b648-f4f659039fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7aecda86-275e-4327-9fc0-3baa95edac73),volume_id=7aecda86-275e-4327-9fc0-3baa95edac73,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:30:16.838513 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (97253d13-b1cc-4d61-be63-d80a67a9b791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:30:16.859602 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:30:16.881205 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:30:16.882021 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:30:16.882669 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:16.883305 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:16.883848 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:16.884409 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] Filtering removed all hosts for the request with volume ID '7aecda86-275e-4327-9fc0-3baa95edac73'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:30:16.885039 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] Filtering removed all hosts for the request with volume ID '7aecda86-275e-4327-9fc0-3baa95edac73'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:30:16.886001 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:30:16.886777 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] Creating message record for request_id = req-2114180e-7037-48f2-9d83-656daf4c01f2 Jul 23 21:30:16.927092 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:30:16.927466 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] Setting Volume 7aecda86-275e-4327-9fc0-3baa95edac73 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:30:16.973484 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (97253d13-b1cc-4d61-be63-d80a67a9b791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:30:16.991445 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2114180e-7037-48f2-9d83-656daf4c01f2 tempest-AbsoluteLimitsTests-2052796391 None] Flow 'volume_create_scheduler' (343aab59-9f6f-4722-831e-785d51ddaa31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:30:22.669017 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=53,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:26.356182 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] Flow 'volume_create_scheduler' (46a8991f-60ec-414f-9217-57ab480fca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:30:26.376284 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c394639d-0d08-4f09-91ef-497c37c37831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:30:26.394311 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c394639d-0d08-4f09-91ef-497c37c37831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b27b20aa-ef1b-4dd1-989e-321af6343d6a,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(10c0fad5-3840-45c0-a5ba-72c54e63f8c5),volume_id=10c0fad5-3840-45c0-a5ba-72c54e63f8c5,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:30:26.408697 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (615677c2-0ac2-4a30-afe1-b71eeaf68c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:30:26.435448 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:30:26.496649 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:30:26.497321 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:30:26.498719 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:26.499178 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:26.501503 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:26.504263 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] Filtering removed all hosts for the request with volume ID '10c0fad5-3840-45c0-a5ba-72c54e63f8c5'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:30:26.504740 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] Filtering removed all hosts for the request with volume ID '10c0fad5-3840-45c0-a5ba-72c54e63f8c5'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:30:26.505373 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:30:26.509052 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] Creating message record for request_id = req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 Jul 23 21:30:26.555264 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:30:26.555863 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] Setting Volume 10c0fad5-3840-45c0-a5ba-72c54e63f8c5 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:30:26.609641 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (615677c2-0ac2-4a30-afe1-b71eeaf68c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:30:26.615331 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2f382ea6-2e67-4646-931e-e65b2b1fcae3 tempest-TaggedBootDevicesTest-849278098 None] Flow 'volume_create_scheduler' (46a8991f-60ec-414f-9217-57ab480fca70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:30:27.464710 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] Flow 'volume_create_scheduler' (13ed33a7-fdab-4316-b7a7-5945eaeb451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:30:27.473486 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (26e6c535-3d38-4af1-b5da-94cd8b3541dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:30:27.488741 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (26e6c535-3d38-4af1-b5da-94cd8b3541dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4a90bc76-ea53-4b81-bbc6-769739a5eb29),volume_id=4a90bc76-ea53-4b81-bbc6-769739a5eb29,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:30:27.506168 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a192b389-670f-4963-a042-37b454b137f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:30:27.525104 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:30:27.561597 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:30:27.562032 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:30:27.563115 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:27.563768 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:27.564233 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:27.564857 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] Filtering removed all hosts for the request with volume ID '4a90bc76-ea53-4b81-bbc6-769739a5eb29'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:30:27.566275 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] Filtering removed all hosts for the request with volume ID '4a90bc76-ea53-4b81-bbc6-769739a5eb29'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:30:27.566923 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:30:27.567450 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] Creating message record for request_id = req-52e1f174-d5de-4f13-91ca-ca284e53d867 Jul 23 21:30:27.582775 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:30:27.583347 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] Setting Volume 4a90bc76-ea53-4b81-bbc6-769739a5eb29 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:30:27.610524 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a192b389-670f-4963-a042-37b454b137f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:30:27.615780 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-52e1f174-d5de-4f13-91ca-ca284e53d867 tempest-VolumesMetadataTest-1517858953 None] Flow 'volume_create_scheduler' (13ed33a7-fdab-4316-b7a7-5945eaeb451b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:30:34.545613 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] Flow 'volume_create_scheduler' (75a56443-d7eb-4bc9-9191-48eb0a9c98af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:30:34.554570 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3e9d852b-5400-4b5d-9a3a-7f81aa4d3fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:30:34.560221 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3e9d852b-5400-4b5d-9a3a-7f81aa4d3fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b27b20aa-ef1b-4dd1-989e-321af6343d6a,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c14e21dd-2715-47bc-9e47-ea5525c3c834),volume_id=c14e21dd-2715-47bc-9e47-ea5525c3c834,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:30:34.574982 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1d5b7e5d-4cdb-4abf-b568-2c36af9b1c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:30:34.590282 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:30:34.656470 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:30:34.656876 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:30:34.657440 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:34.659162 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:34.662165 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:34.662872 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] Filtering removed all hosts for the request with volume ID 'c14e21dd-2715-47bc-9e47-ea5525c3c834'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:30:34.663239 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] Filtering removed all hosts for the request with volume ID 'c14e21dd-2715-47bc-9e47-ea5525c3c834'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:30:34.663792 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:30:34.664450 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] Creating message record for request_id = req-d9064e56-52fd-4203-be19-cdce7ff30459 Jul 23 21:30:34.691504 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:30:34.692128 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] Setting Volume c14e21dd-2715-47bc-9e47-ea5525c3c834 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:30:34.714261 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1d5b7e5d-4cdb-4abf-b568-2c36af9b1c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:30:34.722484 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d9064e56-52fd-4203-be19-cdce7ff30459 tempest-VolumesExtendTest-473882446 None] Flow 'volume_create_scheduler' (75a56443-d7eb-4bc9-9191-48eb0a9c98af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:30:36.589991 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] Flow 'volume_create_scheduler' (8ca6b26f-53d7-4b51-9cc4-d569ee2c2f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:30:36.662530 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (573d72d2-28f4-44e0-b0db-16ca919365b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:30:36.702150 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (573d72d2-28f4-44e0-b0db-16ca919365b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5a095a59-d29b-4827-b89d-990576eeb2d0),volume_id=5a095a59-d29b-4827-b89d-990576eeb2d0,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:30:36.719893 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (592baa72-c433-4c49-a617-aae5054f14c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:30:36.742417 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:30:36.829239 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:30:36.830830 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:30:36.835636 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:36.836306 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:36.836847 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:36.837390 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] Filtering removed all hosts for the request with volume ID '5a095a59-d29b-4827-b89d-990576eeb2d0'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:30:36.837988 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] Filtering removed all hosts for the request with volume ID '5a095a59-d29b-4827-b89d-990576eeb2d0'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:30:36.849613 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:30:36.850367 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] Creating message record for request_id = req-9f55e71b-962d-4884-bd05-c8bcea9acac2 Jul 23 21:30:36.874255 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:30:36.876758 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] Setting Volume 5a095a59-d29b-4827-b89d-990576eeb2d0 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:30:36.900828 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (592baa72-c433-4c49-a617-aae5054f14c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:30:36.905575 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9f55e71b-962d-4884-bd05-c8bcea9acac2 tempest-VolumesExtendTest-473882446 None] Flow 'volume_create_scheduler' (8ca6b26f-53d7-4b51-9cc4-d569ee2c2f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:30:50.126719 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] Flow 'volume_create_scheduler' (62589d7f-74ee-4a92-8f6d-eab698b2a79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:30:50.131385 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d4a16bfe-364d-404d-bb0f-7b9dcfc90d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:30:50.142519 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d4a16bfe-364d-404d-bb0f-7b9dcfc90d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(eac8d84f-bff7-47c4-900c-451dd1635099),volume_id=eac8d84f-bff7-47c4-900c-451dd1635099,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:30:50.145929 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fad805d5-452d-4d61-afbc-17b55ab4a49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:30:50.161448 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:30:50.180336 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:30:50.180697 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:30:50.181042 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:50.181377 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:50.182602 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:30:50.182957 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] Filtering removed all hosts for the request with volume ID 'eac8d84f-bff7-47c4-900c-451dd1635099'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:30:50.183297 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] Filtering removed all hosts for the request with volume ID 'eac8d84f-bff7-47c4-900c-451dd1635099'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:30:50.183781 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:30:50.184364 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] Creating message record for request_id = req-528bb5d6-f302-47d8-b1c0-53cdca51de6e Jul 23 21:30:50.196906 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:30:50.197357 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] Setting Volume eac8d84f-bff7-47c4-900c-451dd1635099 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:30:50.212844 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fad805d5-452d-4d61-afbc-17b55ab4a49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:30:50.224359 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-528bb5d6-f302-47d8-b1c0-53cdca51de6e tempest-VolumesSnapshotTestJSON-594418172 None] Flow 'volume_create_scheduler' (62589d7f-74ee-4a92-8f6d-eab698b2a79d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:31:02.692037 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=67,cinder:UPDATE=14,cinder:INSERT=5,cinder:DELETE=5 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:07.517615 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-764c1510-86b3-41e9-8018-ab28eb569809 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:31:09.527022 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] Flow 'volume_create_scheduler' (9e243629-e397-45fa-97f2-8806511cef64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:31:09.531519 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f6d0e0de-62cb-456e-a80c-9db9d4544a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:31:09.545147 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f6d0e0de-62cb-456e-a80c-9db9d4544a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(78de6468-e160-48ff-a9e3-ce6fbaad37b2),volume_id=78de6468-e160-48ff-a9e3-ce6fbaad37b2,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:31:09.548566 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (425b7571-78b7-4715-9f80-a6fd4c9dfca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:31:09.571068 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:31:09.596735 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:31:09.597473 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:31:09.598162 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:31:09.598972 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:31:09.599558 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:31:09.600105 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] Filtering removed all hosts for the request with volume ID '78de6468-e160-48ff-a9e3-ce6fbaad37b2'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:31:09.601329 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] Filtering removed all hosts for the request with volume ID '78de6468-e160-48ff-a9e3-ce6fbaad37b2'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:31:09.601329 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:31:09.603753 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] Creating message record for request_id = req-b93cab8e-3d50-47fd-981d-265f346242a4 Jul 23 21:31:09.617967 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:31:09.618847 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] Setting Volume 78de6468-e160-48ff-a9e3-ce6fbaad37b2 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:31:09.646061 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (425b7571-78b7-4715-9f80-a6fd4c9dfca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:31:09.650163 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-b93cab8e-3d50-47fd-981d-265f346242a4 tempest-ServersNegativeTestJSON-1106538570 None] Flow 'volume_create_scheduler' (9e243629-e397-45fa-97f2-8806511cef64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:31:12.246115 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] Flow 'volume_create_scheduler' (e02265cc-9a9b-4bc7-8aec-a842b9cc5085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:31:12.253999 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (35c72ce1-4dc5-4ca7-b549-e0f4f9e440c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:31:12.261978 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (35c72ce1-4dc5-4ca7-b549-e0f4f9e440c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(83bdbdaa-f00c-4399-8d2d-f24bf07f8a3d),volume_id=83bdbdaa-f00c-4399-8d2d-f24bf07f8a3d,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:31:12.273292 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7db1e3f8-d2e7-4a50-91a1-856695c3c217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:31:12.297811 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:31:12.323852 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:31:12.324471 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:31:12.325045 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:31:12.325542 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:31:12.326064 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:31:12.326671 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] Filtering removed all hosts for the request with volume ID '83bdbdaa-f00c-4399-8d2d-f24bf07f8a3d'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:31:12.327160 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] Filtering removed all hosts for the request with volume ID '83bdbdaa-f00c-4399-8d2d-f24bf07f8a3d'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:31:12.327799 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:31:12.328423 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] Creating message record for request_id = req-e0ecee10-7518-4f51-a85f-42efc057180a Jul 23 21:31:12.343650 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:31:12.344279 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] Setting Volume 83bdbdaa-f00c-4399-8d2d-f24bf07f8a3d to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:31:12.364271 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7db1e3f8-d2e7-4a50-91a1-856695c3c217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:31:12.368743 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e0ecee10-7518-4f51-a85f-42efc057180a tempest-ServersNegativeTestJSON-1106538570 None] Flow 'volume_create_scheduler' (e02265cc-9a9b-4bc7-8aec-a842b9cc5085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:31:42.700300 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=34,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:44.963309 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] Flow 'volume_create_scheduler' (a3f7debc-0020-48f0-9a7f-096b27455ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:31:44.969171 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e4a22bd6-f1f3-4f37-a568-057d29c734d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:31:44.973622 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e4a22bd6-f1f3-4f37-a568-057d29c734d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9e63f6fa-982a-4f4b-8b81-bac7d9761301),volume_id=9e63f6fa-982a-4f4b-8b81-bac7d9761301,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:31:44.981757 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5fd785fb-1df0-4eda-98ba-1572bfa89e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:31:44.989855 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:31:45.013095 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:31:45.013782 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:31:45.014781 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:31:45.015496 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:31:45.015995 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:31:45.016519 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] Filtering removed all hosts for the request with volume ID '9e63f6fa-982a-4f4b-8b81-bac7d9761301'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:31:45.016863 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] Filtering removed all hosts for the request with volume ID '9e63f6fa-982a-4f4b-8b81-bac7d9761301'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:31:45.017353 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:31:45.017775 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] Creating message record for request_id = req-4bd08523-1a69-4966-84b1-488d21333fd8 Jul 23 21:31:45.030858 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:31:45.031510 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] Setting Volume 9e63f6fa-982a-4f4b-8b81-bac7d9761301 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:31:45.061016 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5fd785fb-1df0-4eda-98ba-1572bfa89e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:31:45.065381 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-4bd08523-1a69-4966-84b1-488d21333fd8 tempest-AttachVolumeNegativeTest-319311902 None] Flow 'volume_create_scheduler' (a3f7debc-0020-48f0-9a7f-096b27455ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:32:07.515566 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-a6cbd0f5-e93e-4845-8a83-7eaf5e9bc8d2 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:32:22.710467 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:40.990437 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] Flow 'volume_create_scheduler' (d0cf5c45-dfc9-49d4-bc02-f6c38113fe45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:32:40.995270 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (cf29470c-c894-4cd4-b119-fa19a3fb3760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:32:41.012011 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (cf29470c-c894-4cd4-b119-fa19a3fb3760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2b1a8b1e-ab84-4491-9b48-1f8b5c2c06e5),volume_id=2b1a8b1e-ab84-4491-9b48-1f8b5c2c06e5,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:32:41.018787 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f2f62805-14a7-4149-ac04-25cd53a5fd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:32:41.029068 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:32:41.061281 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:32:41.062276 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:32:41.063407 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:32:41.064108 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:32:41.065676 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:32:41.066398 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] Filtering removed all hosts for the request with volume ID '2b1a8b1e-ab84-4491-9b48-1f8b5c2c06e5'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:32:41.066956 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] Filtering removed all hosts for the request with volume ID '2b1a8b1e-ab84-4491-9b48-1f8b5c2c06e5'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:32:41.067722 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:32:41.068438 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] Creating message record for request_id = req-a201c74f-4895-4679-8750-06d0aa84fe00 Jul 23 21:32:41.078722 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:32:41.079700 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] Setting Volume 2b1a8b1e-ab84-4491-9b48-1f8b5c2c06e5 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:32:41.094111 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f2f62805-14a7-4149-ac04-25cd53a5fd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:32:41.097219 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-a201c74f-4895-4679-8750-06d0aa84fe00 tempest-VolumesTransfersV355Test-1326243386 None] Flow 'volume_create_scheduler' (d0cf5c45-dfc9-49d4-bc02-f6c38113fe45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:32:42.660213 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] Flow 'volume_create_scheduler' (652994e7-608d-4df0-9d25-50a8880a12a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:32:42.673714 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1e9e88b1-cd53-4e04-8cc5-b23a228301ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:32:42.677616 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1e9e88b1-cd53-4e04-8cc5-b23a228301ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a507c5f8-9be7-4f34-9af8-d33945e7df1f),volume_id=a507c5f8-9be7-4f34-9af8-d33945e7df1f,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:32:42.704126 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c8356422-0771-4c97-8cfb-c31ef68af218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:32:42.730565 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:32:42.791050 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:32:42.791407 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:32:42.791763 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:32:42.792080 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:32:42.798153 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:32:42.798536 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] Filtering removed all hosts for the request with volume ID 'a507c5f8-9be7-4f34-9af8-d33945e7df1f'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:32:42.800681 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] Filtering removed all hosts for the request with volume ID 'a507c5f8-9be7-4f34-9af8-d33945e7df1f'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:32:42.801346 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:32:42.801982 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] Creating message record for request_id = req-6886e494-ff41-40f5-a584-0939f992fcb5 Jul 23 21:32:42.816392 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:32:42.817077 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] Setting Volume a507c5f8-9be7-4f34-9af8-d33945e7df1f to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:32:42.847143 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c8356422-0771-4c97-8cfb-c31ef68af218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:32:42.850936 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-6886e494-ff41-40f5-a584-0939f992fcb5 tempest-VolumesTransfersV355Test-1326243386 None] Flow 'volume_create_scheduler' (652994e7-608d-4df0-9d25-50a8880a12a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:32:49.515415 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] Flow 'volume_create_scheduler' (a852f671-ec8a-4238-bd2d-de77bab10a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:32:49.519961 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (83fd709f-dfbb-4b94-b38b-1f7ad0260f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:32:49.530532 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (83fd709f-dfbb-4b94-b38b-1f7ad0260f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8acbc7b2-d397-4302-939e-fbb86aaec801),volume_id=8acbc7b2-d397-4302-939e-fbb86aaec801,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:32:49.555789 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (30777894-5534-41e8-a08c-24ff55c2691d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:32:49.566547 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:32:49.587023 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:32:49.587647 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:32:49.588153 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:32:49.588653 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:32:49.589140 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:32:49.589670 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] Filtering removed all hosts for the request with volume ID '8acbc7b2-d397-4302-939e-fbb86aaec801'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:32:49.590197 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] Filtering removed all hosts for the request with volume ID '8acbc7b2-d397-4302-939e-fbb86aaec801'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:32:49.590901 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:32:49.591533 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] Creating message record for request_id = req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 Jul 23 21:32:49.602709 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:32:49.603858 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] Setting Volume 8acbc7b2-d397-4302-939e-fbb86aaec801 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:32:49.620249 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (30777894-5534-41e8-a08c-24ff55c2691d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:32:49.625130 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d8b350f1-6269-4fa1-a45d-9d59e955eb16 tempest-AttachVolumeNegativeTest-319311902 None] Flow 'volume_create_scheduler' (a852f671-ec8a-4238-bd2d-de77bab10a16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:33:02.723836 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=45,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:07.516792 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-be7ff8ed-2dd7-4941-ab8a-a0beeeae5095 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:33:11.549917 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] Flow 'volume_create_scheduler' (af54ee32-8666-45d9-a591-a46d9d518b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:33:11.558486 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (63a3073d-1e42-4471-8e72-eefa03b9bb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:33:11.571464 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (63a3073d-1e42-4471-8e72-eefa03b9bb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f73cb912-107e-473c-a6b3-f2b5f8dc7ae2),volume_id=f73cb912-107e-473c-a6b3-f2b5f8dc7ae2,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:33:11.575611 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f8253c4c-7e60-4455-95a9-28c47eee2d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:33:11.588635 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:33:11.605725 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:33:11.606731 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:33:11.607244 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:33:11.607582 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:33:11.608094 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:33:11.608601 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] Filtering removed all hosts for the request with volume ID 'f73cb912-107e-473c-a6b3-f2b5f8dc7ae2'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:33:11.609571 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] Filtering removed all hosts for the request with volume ID 'f73cb912-107e-473c-a6b3-f2b5f8dc7ae2'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:33:11.610257 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:33:11.610834 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] Creating message record for request_id = req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a Jul 23 21:33:11.627512 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:33:11.627887 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] Setting Volume f73cb912-107e-473c-a6b3-f2b5f8dc7ae2 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:33:11.650210 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f8253c4c-7e60-4455-95a9-28c47eee2d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:33:11.653311 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ca845cf3-6c6e-41c7-8ba6-f6af1ca0cf5a tempest-AttachVolumeTestJSON-1227491524 None] Flow 'volume_create_scheduler' (af54ee32-8666-45d9-a591-a46d9d518b7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:33:14.168047 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] Flow 'volume_create_scheduler' (b5bfecf7-d631-4ac8-98a3-8ebe9d19471e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:33:14.173593 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0a90a2ed-9549-47ea-95d1-1242de6b638b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:33:14.178751 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0a90a2ed-9549-47ea-95d1-1242de6b638b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(0fbde89a-8ef9-46b6-9296-f454e368cbf6),volume_id=0fbde89a-8ef9-46b6-9296-f454e368cbf6,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:33:14.184329 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9a8d0170-39a3-4d98-8bbb-f2dbb7d6b628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:33:14.195860 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:33:14.211379 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:33:14.211740 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:33:14.212085 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:33:14.212506 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:33:14.212847 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:33:14.213155 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] Filtering removed all hosts for the request with volume ID '0fbde89a-8ef9-46b6-9296-f454e368cbf6'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:33:14.213516 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] Filtering removed all hosts for the request with volume ID '0fbde89a-8ef9-46b6-9296-f454e368cbf6'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:33:14.213986 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:33:14.214407 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] Creating message record for request_id = req-76f12939-6823-4a0e-9a3f-51b762b1395d Jul 23 21:33:14.224927 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:33:14.225607 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] Setting Volume 0fbde89a-8ef9-46b6-9296-f454e368cbf6 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:33:14.237833 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9a8d0170-39a3-4d98-8bbb-f2dbb7d6b628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:33:14.252202 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-76f12939-6823-4a0e-9a3f-51b762b1395d tempest-AttachVolumeShelveTestJSON-1512806459 None] Flow 'volume_create_scheduler' (b5bfecf7-d631-4ac8-98a3-8ebe9d19471e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:33:34.807389 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=34,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:34.862479 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] Flow 'volume_create_scheduler' (3ba7f1e7-120c-4694-a83e-a17dc027634a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:33:34.867145 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6ed7e60b-78ce-4be0-8900-54df2ec1c0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:33:34.872293 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6ed7e60b-78ce-4be0-8900-54df2ec1c0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(467e206e-e254-4dc1-989b-987ad01a58d5),volume_id=467e206e-e254-4dc1-989b-987ad01a58d5,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:33:34.879392 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (dca98b63-3ba2-4269-bbed-1ea78793bb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:33:34.890455 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:33:34.914173 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:33:34.914720 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:33:34.915221 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:33:34.915717 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:33:34.916932 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:33:34.917434 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] Filtering removed all hosts for the request with volume ID '467e206e-e254-4dc1-989b-987ad01a58d5'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:33:34.917988 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] Filtering removed all hosts for the request with volume ID '467e206e-e254-4dc1-989b-987ad01a58d5'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:33:34.919244 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:33:34.919832 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] Creating message record for request_id = req-026cbadd-b06c-49aa-baa4-c4375d1d20ea Jul 23 21:33:34.929147 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:33:34.930032 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] Setting Volume 467e206e-e254-4dc1-989b-987ad01a58d5 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:33:34.943353 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (dca98b63-3ba2-4269-bbed-1ea78793bb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:33:34.947198 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-026cbadd-b06c-49aa-baa4-c4375d1d20ea tempest-VolumesTestJSON-1452861919 None] Flow 'volume_create_scheduler' (3ba7f1e7-120c-4694-a83e-a17dc027634a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:33:38.468652 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] Flow 'volume_create_scheduler' (9367378c-f413-4270-90ca-7ae554d43a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:33:38.473985 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (523f3318-db2b-4632-bbd0-b1df116b47c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:33:38.478447 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (523f3318-db2b-4632-bbd0-b1df116b47c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(fc108528-d315-4d1a-a09e-998952ad9215),volume_id=fc108528-d315-4d1a-a09e-998952ad9215,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:33:38.482168 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f7d866af-b67a-433c-a47d-baf219e83956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:33:38.491430 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:33:38.505617 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:33:38.506030 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:33:38.506609 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:33:38.510381 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:33:38.510838 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:33:38.511436 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] Filtering removed all hosts for the request with volume ID 'fc108528-d315-4d1a-a09e-998952ad9215'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:33:38.511873 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] Filtering removed all hosts for the request with volume ID 'fc108528-d315-4d1a-a09e-998952ad9215'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:33:38.512467 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:33:38.513023 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] Creating message record for request_id = req-cb28b43a-c1ec-46cd-becd-1370ade33518 Jul 23 21:33:38.521658 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:33:38.522177 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] Setting Volume fc108528-d315-4d1a-a09e-998952ad9215 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:33:38.534813 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f7d866af-b67a-433c-a47d-baf219e83956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:33:38.538392 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca req-cb28b43a-c1ec-46cd-becd-1370ade33518 tempest-VolumesGetTestJSON-617832461 None] Flow 'volume_create_scheduler' (9367378c-f413-4270-90ca-7ae554d43a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:33:49.400496 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] Flow 'volume_create_scheduler' (faa477b2-fb0d-45d5-bcf3-b3a605d80f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:33:49.406519 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1693afd6-8544-4d8a-93b0-2967a1e7c787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:33:49.411330 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1693afd6-8544-4d8a-93b0-2967a1e7c787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9ec414e2-89f2-4071-9e97-f6b41eea9a6e),volume_id=9ec414e2-89f2-4071-9e97-f6b41eea9a6e,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:33:49.420223 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2b457f2e-560d-4902-bc4c-0ec029ced014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:33:49.431455 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:33:49.453474 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:33:49.453829 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:33:49.454525 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:33:49.454923 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:33:49.455471 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:33:49.455984 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] Filtering removed all hosts for the request with volume ID '9ec414e2-89f2-4071-9e97-f6b41eea9a6e'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:33:49.456451 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] Filtering removed all hosts for the request with volume ID '9ec414e2-89f2-4071-9e97-f6b41eea9a6e'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:33:49.457099 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:33:49.457567 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] Creating message record for request_id = req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 Jul 23 21:33:49.466295 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:33:49.466773 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] Setting Volume 9ec414e2-89f2-4071-9e97-f6b41eea9a6e to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:33:49.480257 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2b457f2e-560d-4902-bc4c-0ec029ced014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:33:49.483394 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9d9aa3ca-f959-41b0-a9b8-1a29153a7971 tempest-AttachVolumeNegativeTest-319311902 None] Flow 'volume_create_scheduler' (faa477b2-fb0d-45d5-bcf3-b3a605d80f52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:34:07.510650 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-c99ada6b-753f-40ff-9617-fc58cf288f95 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:34:12.717905 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=42,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:18.504772 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] Flow 'volume_create_scheduler' (2073c6ef-6ae2-41df-a984-468d5dcec837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:34:18.516709 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b69dd143-cedf-4436-a346-7124e37d6acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:34:18.520671 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b69dd143-cedf-4436-a346-7124e37d6acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(730c9c90-6cf1-423f-937f-6f759b36a7fa),volume_id=730c9c90-6cf1-423f-937f-6f759b36a7fa,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:34:18.524309 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (eaea41e6-02df-4b29-b3d8-c70f08dcb3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:34:18.547071 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:34:18.564328 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:34:18.564966 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:34:18.565369 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:34:18.565707 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:34:18.566297 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:34:18.567109 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] Filtering removed all hosts for the request with volume ID '730c9c90-6cf1-423f-937f-6f759b36a7fa'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:34:18.567728 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] Filtering removed all hosts for the request with volume ID '730c9c90-6cf1-423f-937f-6f759b36a7fa'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:34:18.568461 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:34:18.569143 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] Creating message record for request_id = req-274a774b-fa34-4cf0-936c-7cc31ff55d19 Jul 23 21:34:18.581679 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:34:18.582570 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] Setting Volume 730c9c90-6cf1-423f-937f-6f759b36a7fa to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:34:18.597743 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (eaea41e6-02df-4b29-b3d8-c70f08dcb3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:34:18.607519 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-274a774b-fa34-4cf0-936c-7cc31ff55d19 tempest-AttachVolumeTestJSON-1227491524 None] Flow 'volume_create_scheduler' (2073c6ef-6ae2-41df-a984-468d5dcec837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:34:22.685214 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] Flow 'volume_create_scheduler' (11456a21-d5c8-4b8c-b72b-e0c9470e2e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:34:22.693257 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4cb732a2-b761-42d7-ad6d-9d61bfcda8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:34:22.699706 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4cb732a2-b761-42d7-ad6d-9d61bfcda8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a68425ea-f712-4662-8b44-573af92c622f),volume_id=a68425ea-f712-4662-8b44-573af92c622f,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:34:22.706253 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (46b7cdbd-307d-47b0-8175-05dc9eafefc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:34:22.719588 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:34:22.752047 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:34:22.752439 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:34:22.752778 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:34:22.753315 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:34:22.754150 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:34:22.754866 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] Filtering removed all hosts for the request with volume ID 'a68425ea-f712-4662-8b44-573af92c622f'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:34:22.755427 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] Filtering removed all hosts for the request with volume ID 'a68425ea-f712-4662-8b44-573af92c622f'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:34:22.756559 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:34:22.757444 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] Creating message record for request_id = req-01074f43-a07f-444e-bdbe-3e4125f84e01 Jul 23 21:34:22.771003 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:34:22.771520 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] Setting Volume a68425ea-f712-4662-8b44-573af92c622f to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:34:22.787293 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (46b7cdbd-307d-47b0-8175-05dc9eafefc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:34:22.794657 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-01074f43-a07f-444e-bdbe-3e4125f84e01 tempest-AttachVolumeShelveTestJSON-1512806459 None] Flow 'volume_create_scheduler' (11456a21-d5c8-4b8c-b72b-e0c9470e2e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:34:39.888249 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] Flow 'volume_create_scheduler' (97d50ec8-0277-4624-9dd4-770ca62fc680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:34:39.894128 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0ce55e94-1a7c-471c-a341-69ed45d7f7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:34:39.898712 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0ce55e94-1a7c-471c-a341-69ed45d7f7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2632ea0e-32de-4dc5-99e4-12c8d6daa898),volume_id=2632ea0e-32de-4dc5-99e4-12c8d6daa898,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:34:39.925342 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a4671c24-f2ee-4885-8218-b0849311c819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:34:39.936266 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:34:39.958215 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:34:39.960405 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:34:39.960959 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:34:39.961646 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:34:39.962476 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:34:39.962990 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] Filtering removed all hosts for the request with volume ID '2632ea0e-32de-4dc5-99e4-12c8d6daa898'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:34:39.963723 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] Filtering removed all hosts for the request with volume ID '2632ea0e-32de-4dc5-99e4-12c8d6daa898'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:34:39.965192 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:34:39.965908 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] Creating message record for request_id = req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 Jul 23 21:34:39.980340 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:34:39.980837 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] Setting Volume 2632ea0e-32de-4dc5-99e4-12c8d6daa898 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:34:40.006643 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a4671c24-f2ee-4885-8218-b0849311c819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:34:40.010137 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 req-3c51aab1-d69a-4d3f-927a-7c1b3b853d98 tempest-VolumesSnapshotsTestJSON-1533761412 None] Flow 'volume_create_scheduler' (97d50ec8-0277-4624-9dd4-770ca62fc680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:34:42.738999 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=44,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:07.509199 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-409d3718-be69-4e6b-a75b-98e59cee7707 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:35:22.734563 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:52.748421 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:04.852501 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-501ac5bc-079f-48f4-b280-148ec0b445a1 tempest-GroupsV314Test-2072100930 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:36:04.872935 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-501ac5bc-079f-48f4-b280-148ec0b445a1 tempest-GroupsV314Test-2072100930 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:36:04.873539 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.manager [None req-501ac5bc-079f-48f4-b280-148ec0b445a1 tempest-GroupsV314Test-2072100930 None] Could not find a backend for group ec1e00a2-245f-41fd-b018-faaed3f0967b.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:36:07.514827 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-243142f0-ff31-4070-8633-a71715948119 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:36:14.436211 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] Flow 'volume_create_scheduler' (224ca048-5719-47fb-96bb-abda91ca3835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:36:14.445391 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fc017f7c-9ea7-4b92-b2a5-f8023c890ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:36:14.450565 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fc017f7c-9ea7-4b92-b2a5-f8023c890ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4cc71771-3df4-4780-99d3-366c49548f2c),volume_id=4cc71771-3df4-4780-99d3-366c49548f2c,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:36:14.461140 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3d3c2a49-b484-4f11-a598-93d5a9ce20d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:36:14.474795 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:36:14.495195 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:36:14.495903 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:36:14.497110 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:14.497663 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:14.498304 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:14.499798 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] Filtering removed all hosts for the request with volume ID '4cc71771-3df4-4780-99d3-366c49548f2c'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:36:14.500375 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] Filtering removed all hosts for the request with volume ID '4cc71771-3df4-4780-99d3-366c49548f2c'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:36:14.501197 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:36:14.501822 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] Creating message record for request_id = req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b Jul 23 21:36:14.518680 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:36:14.519244 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] Setting Volume 4cc71771-3df4-4780-99d3-366c49548f2c to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:36:14.543839 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3d3c2a49-b484-4f11-a598-93d5a9ce20d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:36:14.551938 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-56519b8a-f3f3-48ee-bf56-a0e1fd981f4b tempest-VolumeQuotasAdminTestJSON-811467950 None] Flow 'volume_create_scheduler' (224ca048-5719-47fb-96bb-abda91ca3835) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:36:16.010497 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] Flow 'volume_create_scheduler' (5e657250-31fd-4818-a68f-d02bba0398d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:36:16.016666 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (00b2f674-dcbe-4c2d-914a-11aaad8e307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:36:16.020681 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (00b2f674-dcbe-4c2d-914a-11aaad8e307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(60989e00-404a-4708-98d2-bbd19bbbc50e),volume_id=60989e00-404a-4708-98d2-bbd19bbbc50e,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:36:16.026003 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6e2e37f0-0887-47b5-8abe-45750b0e4595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:36:16.043968 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:36:16.068483 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:36:16.068840 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:36:16.069189 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:16.069529 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:16.069891 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:16.070263 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] Filtering removed all hosts for the request with volume ID '60989e00-404a-4708-98d2-bbd19bbbc50e'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:36:16.070602 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] Filtering removed all hosts for the request with volume ID '60989e00-404a-4708-98d2-bbd19bbbc50e'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:36:16.071083 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:36:16.071495 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] Creating message record for request_id = req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f Jul 23 21:36:16.086722 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:36:16.087119 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] Setting Volume 60989e00-404a-4708-98d2-bbd19bbbc50e to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:36:16.100327 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6e2e37f0-0887-47b5-8abe-45750b0e4595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:36:16.104628 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e9f6f7f4-5d45-4ffe-ac65-9b3c14c70b4f tempest-VolumeQuotasAdminTestJSON-811467950 None] Flow 'volume_create_scheduler' (5e657250-31fd-4818-a68f-d02bba0398d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:36:26.392497 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=9,cinder:SELECT=37,cinder:INSERT=2,cinder:DELETE=2 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:26.459354 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] Flow 'volume_create_scheduler' (fbb0b8d7-762c-4b8c-9939-b33d13f301b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:36:26.465659 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7b2d9048-c24d-4af8-9ef3-d5c2ac31b6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:36:26.488429 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7b2d9048-c24d-4af8-9ef3-d5c2ac31b6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(6c15edb6-e1f6-4c43-8ec2-26a1d74f181f),volume_id=6c15edb6-e1f6-4c43-8ec2-26a1d74f181f,volume_properties=VolumeProperties,volume_type=VolumeType(787243f5-47af-4542-b99f-f4c451197926))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:36:26.496760 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (de9af795-91fc-47c9-b6c8-182c19a633b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:36:26.517441 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:36:26.553002 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:36:26.553799 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:36:26.554396 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:26.554969 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:26.555517 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:26.556097 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] Filtering removed all hosts for the request with volume ID '6c15edb6-e1f6-4c43-8ec2-26a1d74f181f'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:36:26.556779 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] Filtering removed all hosts for the request with volume ID '6c15edb6-e1f6-4c43-8ec2-26a1d74f181f'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:36:26.557486 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] No weighed backend found for volume with properties: {'id': '787243f5-47af-4542-b99f-f4c451197926', 'name': 'tempest-VolumeTypesAccessTest-volume-type-1024366576', 'description': None, 'is_public': False, 'projects': [], 'extra_specs': {}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:36:26.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:36:26.558370 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] Creating message record for request_id = req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 Jul 23 21:36:26.570009 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:36:26.571039 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] Setting Volume 6c15edb6-e1f6-4c43-8ec2-26a1d74f181f to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:36:26.589097 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (de9af795-91fc-47c9-b6c8-182c19a633b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:36:26.597184 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-3e7a517e-e88e-43d3-b9cc-eb4ba0963da4 tempest-VolumeTypesAccessTest-173735447 None] Flow 'volume_create_scheduler' (fbb0b8d7-762c-4b8c-9939-b33d13f301b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:36:36.659787 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] Flow 'volume_create_scheduler' (a8e5c4f7-434b-451c-8e28-6152e5f28d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:36:36.665450 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (23edffe6-3cf4-431a-98f9-f223e225b743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:36:36.670329 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (23edffe6-3cf4-431a-98f9-f223e225b743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(054d09c1-8d30-470c-98dd-8e8211eb32d2),volume_id=054d09c1-8d30-470c-98dd-8e8211eb32d2,volume_properties=VolumeProperties,volume_type=VolumeType(366d7d5e-ffc8-465b-882c-85e15093ad4d))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:36:36.673900 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (220f4b63-5632-4c5a-857c-4c5a9df75f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:36:36.685764 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:36:36.726342 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:36:36.726779 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:36:36.727187 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:36.727668 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:36.728249 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:36.728742 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] Filtering removed all hosts for the request with volume ID '054d09c1-8d30-470c-98dd-8e8211eb32d2'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:36:36.729380 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] Filtering removed all hosts for the request with volume ID '054d09c1-8d30-470c-98dd-8e8211eb32d2'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:36:36.730022 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] No weighed backend found for volume with properties: {'id': '366d7d5e-ffc8-465b-882c-85e15093ad4d', 'name': 'tempest-VolumeTypesTest-volume-type-1044297798', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:36:36.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:36:36.732054 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] Creating message record for request_id = req-b5344f01-a0df-4817-b1cd-e38aee3b489b Jul 23 21:36:36.748990 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:36:36.749380 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] Setting Volume 054d09c1-8d30-470c-98dd-8e8211eb32d2 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:36:36.767758 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (220f4b63-5632-4c5a-857c-4c5a9df75f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:36:36.773479 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-b5344f01-a0df-4817-b1cd-e38aee3b489b tempest-VolumeTypesTest-876134726 None] Flow 'volume_create_scheduler' (a8e5c4f7-434b-451c-8e28-6152e5f28d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:36:50.297017 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] Flow 'volume_create_scheduler' (b898077d-c499-4805-922a-fe2bb7bec9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:36:50.310757 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5abe167c-0c66-4972-9ce5-c13e711d5a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:36:50.325273 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5abe167c-0c66-4972-9ce5-c13e711d5a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b27b20aa-ef1b-4dd1-989e-321af6343d6a,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(17f11009-9133-4554-a345-b875a1f38176),volume_id=17f11009-9133-4554-a345-b875a1f38176,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:36:50.329991 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (044cb8af-aa75-4d5e-b4a5-c3341e264f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:36:50.347041 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:36:50.365477 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:36:50.365846 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:36:50.366363 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:50.367375 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:50.367731 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:50.368247 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] Filtering removed all hosts for the request with volume ID '17f11009-9133-4554-a345-b875a1f38176'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:36:50.368595 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] Filtering removed all hosts for the request with volume ID '17f11009-9133-4554-a345-b875a1f38176'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:36:50.369094 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:36:50.369525 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] Creating message record for request_id = req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 Jul 23 21:36:50.382523 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:36:50.382996 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] Setting Volume 17f11009-9133-4554-a345-b875a1f38176 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:36:50.399962 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (044cb8af-aa75-4d5e-b4a5-c3341e264f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:36:50.404535 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d9e8ccea-651c-4076-ad5e-89354a8ebeb4 tempest-VolumesCloneTest-1167794312 None] Flow 'volume_create_scheduler' (b898077d-c499-4805-922a-fe2bb7bec9d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:36:51.772863 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] Flow 'volume_create_scheduler' (c18066a9-b272-44ba-aeaf-99a1835c4ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:36:51.778766 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4138cbe3-e8ec-4efb-8350-07642c69c46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:36:51.784670 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4138cbe3-e8ec-4efb-8350-07642c69c46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(32304df7-96d2-450b-8ac9-99943b2cbc81),volume_id=32304df7-96d2-450b-8ac9-99943b2cbc81,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:36:51.790408 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (81b9d911-4ec2-4db6-977a-baa06ee5edb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:36:51.809912 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:36:51.843909 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:36:51.843909 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:36:51.843909 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:51.843909 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:51.843909 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:36:51.844807 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] Filtering removed all hosts for the request with volume ID '32304df7-96d2-450b-8ac9-99943b2cbc81'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:36:51.844945 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] Filtering removed all hosts for the request with volume ID '32304df7-96d2-450b-8ac9-99943b2cbc81'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:36:51.847216 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:36:51.848278 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] Creating message record for request_id = req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 Jul 23 21:36:51.861381 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:36:51.861752 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] Setting Volume 32304df7-96d2-450b-8ac9-99943b2cbc81 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:36:51.883797 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (81b9d911-4ec2-4db6-977a-baa06ee5edb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:36:51.889163 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-c13a7e91-3ee1-493a-99b2-3e7c25e51c51 tempest-VolumesCloneTest-1167794312 None] Flow 'volume_create_scheduler' (c18066a9-b272-44ba-aeaf-99a1835c4ec9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:37:02.742029 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=53,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:07.515682 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-518773ea-f602-4b0d-b9f1-d99d5e6f8aba None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:37:34.571636 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:34.599923 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] Flow 'volume_create_scheduler' (f6f966ac-7995-42b3-b97e-65c5c32c95b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:37:34.604023 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d2767864-2dc0-4de8-a5e7-49a97163536c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:37:34.608037 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d2767864-2dc0-4de8-a5e7-49a97163536c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(90fd2cd2-cf04-463a-a27e-f848ee93c8f6),volume_id=90fd2cd2-cf04-463a-a27e-f848ee93c8f6,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:37:34.611496 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9baca650-67e0-4ee1-8854-d747d4858d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:37:34.620180 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:37:34.640833 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:37:34.641320 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:37:34.641673 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:37:34.642067 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:37:34.642423 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:37:34.642763 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] Filtering removed all hosts for the request with volume ID '90fd2cd2-cf04-463a-a27e-f848ee93c8f6'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:37:34.643096 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] Filtering removed all hosts for the request with volume ID '90fd2cd2-cf04-463a-a27e-f848ee93c8f6'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:37:34.643601 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:37:34.644013 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] Creating message record for request_id = req-440564fa-12ca-4841-86f5-a7ad350dcb19 Jul 23 21:37:34.651133 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:37:34.651518 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] Setting Volume 90fd2cd2-cf04-463a-a27e-f848ee93c8f6 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:37:34.662474 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9baca650-67e0-4ee1-8854-d747d4858d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:37:34.665643 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-440564fa-12ca-4841-86f5-a7ad350dcb19 tempest-SnapshotsActionsTest-388084405 None] Flow 'volume_create_scheduler' (f6f966ac-7995-42b3-b97e-65c5c32c95b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:37:52.748957 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] Flow 'volume_create_scheduler' (cad7525c-1f44-4023-9627-abb5fcfca0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:37:52.760742 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d76878b3-96b9-4316-8ee3-57e4932393c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:37:52.774565 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d76878b3-96b9-4316-8ee3-57e4932393c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(20a090b7-e17a-4111-bb8b-2693a521eeaa),volume_id=20a090b7-e17a-4111-bb8b-2693a521eeaa,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:37:52.786603 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (eae03829-be83-4ace-b891-3294e0170cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:37:52.801991 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:37:52.861058 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:37:52.861433 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:37:52.861787 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:37:52.862166 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:37:52.862510 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:37:52.862852 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] Filtering removed all hosts for the request with volume ID '20a090b7-e17a-4111-bb8b-2693a521eeaa'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:37:52.866405 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] Filtering removed all hosts for the request with volume ID '20a090b7-e17a-4111-bb8b-2693a521eeaa'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:37:52.867105 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:37:52.867956 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] Creating message record for request_id = req-2b791949-6c6b-44e6-b7d9-920161be1c42 Jul 23 21:37:52.884144 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:37:52.885723 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] Setting Volume 20a090b7-e17a-4111-bb8b-2693a521eeaa to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:37:52.906839 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (eae03829-be83-4ace-b891-3294e0170cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:37:52.910249 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2b791949-6c6b-44e6-b7d9-920161be1c42 tempest-VolumeQuotasNegativeTestJSON-697327357 None] Flow 'volume_create_scheduler' (cad7525c-1f44-4023-9627-abb5fcfca0f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:37:58.838644 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] Flow 'volume_create_scheduler' (1b3dd072-f40a-414f-938d-23be4d6e7d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:37:58.844325 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (59466c48-c2ae-47cb-9057-2c37b649174c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:37:58.848576 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (59466c48-c2ae-47cb-9057-2c37b649174c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7a40f79c-8ebf-4626-9227-5ba23bda38af),volume_id=7a40f79c-8ebf-4626-9227-5ba23bda38af,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:37:58.851828 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e2c7db7e-f018-4b18-8f29-b697c189db0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:37:58.860031 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:37:58.873988 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:37:58.874344 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:37:58.874687 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:37:58.875021 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:37:58.875351 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:37:58.875685 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] Filtering removed all hosts for the request with volume ID '7a40f79c-8ebf-4626-9227-5ba23bda38af'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:37:58.876013 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] Filtering removed all hosts for the request with volume ID '7a40f79c-8ebf-4626-9227-5ba23bda38af'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:37:58.876495 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:37:58.876895 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] Creating message record for request_id = req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b Jul 23 21:37:58.884387 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:37:58.885357 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] Setting Volume 7a40f79c-8ebf-4626-9227-5ba23bda38af to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:37:58.896578 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e2c7db7e-f018-4b18-8f29-b697c189db0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:37:58.900023 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d7d9493a-e7a4-41fa-9cfe-c27d453c2d2b tempest-VolumeSnapshotQuotasNegativeTestJSON-802905143 None] Flow 'volume_create_scheduler' (1b3dd072-f40a-414f-938d-23be4d6e7d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:07.510292 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-585813e0-14e5-4e2f-ac37-e3bb8e264af4 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:38:12.835915 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=42,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:13.409550 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] Flow 'volume_create_scheduler' (0abb2ae9-d136-412c-b54a-feee9b6610c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:13.426273 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e2a6dc4b-87da-4088-a17e-80b0b45bc9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:13.441432 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e2a6dc4b-87da-4088-a17e-80b0b45bc9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(54308db8-b3af-474f-b3ab-3d1ec5eff27b),volume_id=54308db8-b3af-474f-b3ab-3d1ec5eff27b,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:13.452030 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (838c48ac-9a41-4f97-8187-d048c59e3fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:13.468616 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:38:13.489797 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:38:13.492930 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:38:13.498030 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:13.498642 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:13.498999 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:13.499354 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] Filtering removed all hosts for the request with volume ID '54308db8-b3af-474f-b3ab-3d1ec5eff27b'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:38:13.499698 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] Filtering removed all hosts for the request with volume ID '54308db8-b3af-474f-b3ab-3d1ec5eff27b'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:38:13.500208 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:38:13.500635 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] Creating message record for request_id = req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb Jul 23 21:38:13.519217 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:38:13.519612 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] Setting Volume 54308db8-b3af-474f-b3ab-3d1ec5eff27b to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:38:13.534744 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (838c48ac-9a41-4f97-8187-d048c59e3fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:13.539252 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-831141f4-ab89-4b7b-a8a1-7fd629e6c8bb tempest-VolumesActionsTest-1839730395 None] Flow 'volume_create_scheduler' (0abb2ae9-d136-412c-b54a-feee9b6610c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:14.630253 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-363f243c-703e-4a8a-a72c-3b464ebd8101 tempest-GroupSnapshotsTest-230158833 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:38:14.637195 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-363f243c-703e-4a8a-a72c-3b464ebd8101 tempest-GroupSnapshotsTest-230158833 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:38:14.637715 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.manager [None req-363f243c-703e-4a8a-a72c-3b464ebd8101 tempest-GroupSnapshotsTest-230158833 None] Could not find a backend for group 1553f3e1-ac1c-4397-81ec-ad7250fb728f.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:38:16.289421 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-ab71b520-6ab5-4dcb-ba5c-6379d57e236c tempest-GroupSnapshotsTest-230158833 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:38:16.300387 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-ab71b520-6ab5-4dcb-ba5c-6379d57e236c tempest-GroupSnapshotsTest-230158833 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:38:16.301004 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.manager [None req-ab71b520-6ab5-4dcb-ba5c-6379d57e236c tempest-GroupSnapshotsTest-230158833 None] Could not find a backend for group 003d8cc2-08d7-4344-966b-77a90e4ef2bd.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:38:17.836240 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] Flow 'volume_create_scheduler' (170ed2ed-5040-4ed7-a440-1e3ffdb9953d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:17.841585 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5eefe4d3-ca99-4864-a9a7-8ec22ae1c757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:17.845500 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5eefe4d3-ca99-4864-a9a7-8ec22ae1c757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2bad5910-3d96-4c6d-a268-a7ffbd726288),volume_id=2bad5910-3d96-4c6d-a268-a7ffbd726288,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:17.855025 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f94a6d6b-602b-4f29-be2f-66d5c9537ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:17.863899 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:38:17.881594 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:38:17.883760 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:38:17.883972 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:17.884315 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:17.884657 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:17.885010 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] Filtering removed all hosts for the request with volume ID '2bad5910-3d96-4c6d-a268-a7ffbd726288'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:38:17.885348 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] Filtering removed all hosts for the request with volume ID '2bad5910-3d96-4c6d-a268-a7ffbd726288'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:38:17.885839 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:38:17.886435 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] Creating message record for request_id = req-8f271123-254e-43a4-84d5-eeb75cb4f168 Jul 23 21:38:17.908693 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:38:17.909212 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] Setting Volume 2bad5910-3d96-4c6d-a268-a7ffbd726288 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:38:17.926272 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f94a6d6b-602b-4f29-be2f-66d5c9537ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:17.930101 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-8f271123-254e-43a4-84d5-eeb75cb4f168 tempest-VolumesBackupsTest-312763049 None] Flow 'volume_create_scheduler' (170ed2ed-5040-4ed7-a440-1e3ffdb9953d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:18.324635 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-7ab80569-bbfa-4011-939a-1ae8fefb3a38 tempest-GroupSnapshotsTest-230158833 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:38:18.342735 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-7ab80569-bbfa-4011-939a-1ae8fefb3a38 tempest-GroupSnapshotsTest-230158833 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:38:18.343271 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.manager [None req-7ab80569-bbfa-4011-939a-1ae8fefb3a38 tempest-GroupSnapshotsTest-230158833 None] Could not find a backend for group 179be926-5f3b-43be-b33a-2f828aeacb4e.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:38:19.496601 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] Flow 'volume_create_scheduler' (11f655bb-023a-4063-90bf-c3162e91407e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:19.502491 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fe8b9c7d-5d52-4243-8886-d74b460ad33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:19.510943 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fe8b9c7d-5d52-4243-8886-d74b460ad33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b27b20aa-ef1b-4dd1-989e-321af6343d6a,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(0a5ad71c-32f7-4586-b3bb-b6e9d481cc61),volume_id=0a5ad71c-32f7-4586-b3bb-b6e9d481cc61,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:19.515471 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (022f7c37-598b-469f-b75b-c4c9bbc2d6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:19.530548 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:38:19.550259 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:38:19.550928 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:38:19.551460 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:19.551987 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:19.552523 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:19.553091 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] Filtering removed all hosts for the request with volume ID '0a5ad71c-32f7-4586-b3bb-b6e9d481cc61'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:38:19.553964 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] Filtering removed all hosts for the request with volume ID '0a5ad71c-32f7-4586-b3bb-b6e9d481cc61'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:38:19.554790 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:38:19.555676 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] Creating message record for request_id = req-14a55a09-403a-4099-8a4b-ea87283f86a8 Jul 23 21:38:19.567481 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:38:19.568282 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] Setting Volume 0a5ad71c-32f7-4586-b3bb-b6e9d481cc61 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:38:19.588748 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (022f7c37-598b-469f-b75b-c4c9bbc2d6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:19.595259 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-14a55a09-403a-4099-8a4b-ea87283f86a8 tempest-VolumesBackupsTest-312763049 None] Flow 'volume_create_scheduler' (11f655bb-023a-4063-90bf-c3162e91407e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:32.847652 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=53,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:48.710372 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] Flow 'volume_create_scheduler' (01719cd4-1903-4f1e-a47c-647e6faa3d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:48.724086 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7ff51e9c-ecb6-4974-849a-89ea19c9745e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:48.729680 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7ff51e9c-ecb6-4974-849a-89ea19c9745e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(386ed5aa-8ebe-40e2-b7f4-325820d23ab8),volume_id=386ed5aa-8ebe-40e2-b7f4-325820d23ab8,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:48.750071 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f3c4a35c-cfb3-4775-88c5-21321a762018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:48.770436 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:38:48.800449 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:38:48.800980 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:38:48.801401 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:48.801819 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:48.802240 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:48.802653 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] Filtering removed all hosts for the request with volume ID '386ed5aa-8ebe-40e2-b7f4-325820d23ab8'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:38:48.803058 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] Filtering removed all hosts for the request with volume ID '386ed5aa-8ebe-40e2-b7f4-325820d23ab8'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:38:48.803882 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:38:48.804963 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] Creating message record for request_id = req-9631ed5c-f115-4e0e-be05-999da9812c93 Jul 23 21:38:48.838923 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:38:48.839959 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] Setting Volume 386ed5aa-8ebe-40e2-b7f4-325820d23ab8 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:38:48.872108 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f3c4a35c-cfb3-4775-88c5-21321a762018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:48.876814 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-9631ed5c-f115-4e0e-be05-999da9812c93 tempest-VolumesActionsTest-821932292 None] Flow 'volume_create_scheduler' (01719cd4-1903-4f1e-a47c-647e6faa3d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:54.986922 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] Flow 'volume_create_scheduler' (b6d097a4-63f8-4c0c-b26b-451f81770353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:54.992292 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3fd061d7-f254-4f2f-a7ea-2e51f22e7901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:55.000256 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3fd061d7-f254-4f2f-a7ea-2e51f22e7901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9f5e0599-e2bb-4633-975a-2a0fcccd27ba),volume_id=9f5e0599-e2bb-4633-975a-2a0fcccd27ba,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:55.004592 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f5af46ad-69e2-4b18-8800-d36c245b279f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:55.019967 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:38:55.050870 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:38:55.051165 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:38:55.051519 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:55.051843 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:55.052351 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:55.052841 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] Filtering removed all hosts for the request with volume ID '9f5e0599-e2bb-4633-975a-2a0fcccd27ba'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:38:55.053325 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] Filtering removed all hosts for the request with volume ID '9f5e0599-e2bb-4633-975a-2a0fcccd27ba'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:38:55.054102 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:38:55.054666 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] Creating message record for request_id = req-5b944d3e-7d69-4987-8152-b887589de8e3 Jul 23 21:38:55.073625 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:38:55.074041 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] Setting Volume 9f5e0599-e2bb-4633-975a-2a0fcccd27ba to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:38:55.093919 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f5af46ad-69e2-4b18-8800-d36c245b279f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:55.097355 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5b944d3e-7d69-4987-8152-b887589de8e3 tempest-VolumesActionsTest-821932292 None] Flow 'volume_create_scheduler' (b6d097a4-63f8-4c0c-b26b-451f81770353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:56.470016 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] Flow 'volume_create_scheduler' (bddf97ce-2a1c-4f73-b7bf-1ad1dd608b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:56.485641 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3c7288b9-ed06-4c0b-b443-6d78cd4ddc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:56.514775 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3c7288b9-ed06-4c0b-b443-6d78cd4ddc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e38ccae0-3a39-41e5-b0de-efafb7ce0055),volume_id=e38ccae0-3a39-41e5-b0de-efafb7ce0055,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:56.521172 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d601abd2-c701-4572-92c7-2cd71605be09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:56.538929 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:38:56.570938 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:38:56.571499 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:38:56.571940 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:56.572497 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:56.573006 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:56.573443 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] Filtering removed all hosts for the request with volume ID 'e38ccae0-3a39-41e5-b0de-efafb7ce0055'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:38:56.573887 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] Filtering removed all hosts for the request with volume ID 'e38ccae0-3a39-41e5-b0de-efafb7ce0055'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:38:56.574484 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:38:56.574998 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] Creating message record for request_id = req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 Jul 23 21:38:56.605335 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:38:56.605760 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] Setting Volume e38ccae0-3a39-41e5-b0de-efafb7ce0055 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:38:56.632191 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d601abd2-c701-4572-92c7-2cd71605be09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:56.636521 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-ec3a38e6-5d36-4a94-b72a-14e2fa973298 tempest-VolumesActionsTest-821932292 None] Flow 'volume_create_scheduler' (bddf97ce-2a1c-4f73-b7bf-1ad1dd608b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:57.883739 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] Flow 'volume_create_scheduler' (dfb24c21-2f50-4e6e-84bc-4404e599f79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:57.889480 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2d71260f-ba22-43ba-a7a9-c8639e5f8ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:57.893834 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2d71260f-ba22-43ba-a7a9-c8639e5f8ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(67f74fe8-22aa-41dc-a020-da1d2b198549),volume_id=67f74fe8-22aa-41dc-a020-da1d2b198549,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:57.898786 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (911c18d8-f2f7-4cba-b3e3-05432c4d7256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:57.910475 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:38:57.927830 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:38:57.928237 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:38:57.928686 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:57.929283 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:57.930334 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:57.930785 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] Filtering removed all hosts for the request with volume ID '67f74fe8-22aa-41dc-a020-da1d2b198549'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:38:57.931224 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] Filtering removed all hosts for the request with volume ID '67f74fe8-22aa-41dc-a020-da1d2b198549'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:38:57.931931 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:38:57.932451 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] Creating message record for request_id = req-e5d4defc-6bab-4931-97d2-6eee70cc013c Jul 23 21:38:57.943224 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:38:57.944000 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] Setting Volume 67f74fe8-22aa-41dc-a020-da1d2b198549 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:38:57.969557 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (911c18d8-f2f7-4cba-b3e3-05432c4d7256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:57.974637 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e5d4defc-6bab-4931-97d2-6eee70cc013c tempest-VolumesActionsTest-821932292 None] Flow 'volume_create_scheduler' (dfb24c21-2f50-4e6e-84bc-4404e599f79b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:59.294153 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] Flow 'volume_create_scheduler' (bc24f97e-9419-4495-ba7b-48adc981d2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:38:59.300759 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c5db478c-8b48-4d7c-97fc-e82c147e416d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:59.304963 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c5db478c-8b48-4d7c-97fc-e82c147e416d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e1175a5a-c469-4b5e-a7b4-a384794a0040),volume_id=e1175a5a-c469-4b5e-a7b4-a384794a0040,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:59.309249 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0a243022-7818-45ea-834a-6ddb07c97c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:38:59.318547 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:38:59.335484 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:38:59.336053 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:38:59.336547 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:59.337219 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:59.337697 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:38:59.338291 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] Filtering removed all hosts for the request with volume ID 'e1175a5a-c469-4b5e-a7b4-a384794a0040'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:38:59.338780 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] Filtering removed all hosts for the request with volume ID 'e1175a5a-c469-4b5e-a7b4-a384794a0040'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:38:59.340049 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:38:59.340636 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] Creating message record for request_id = req-1c28989a-b899-42e3-9a39-7b96d7c6365f Jul 23 21:38:59.348861 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:38:59.349345 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] Setting Volume e1175a5a-c469-4b5e-a7b4-a384794a0040 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:38:59.360970 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0a243022-7818-45ea-834a-6ddb07c97c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:38:59.364395 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-1c28989a-b899-42e3-9a39-7b96d7c6365f tempest-VolumesActionsTest-821932292 None] Flow 'volume_create_scheduler' (bc24f97e-9419-4495-ba7b-48adc981d2c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:39:00.751168 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] Flow 'volume_create_scheduler' (6086122d-aed5-494a-92e7-69231f52e39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:39:00.757237 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a6630769-e34c-4e60-8872-d61e43b3db2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:39:00.763792 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a6630769-e34c-4e60-8872-d61e43b3db2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7b79e572-7d3b-4fb4-b1fe-2908050675da),volume_id=7b79e572-7d3b-4fb4-b1fe-2908050675da,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:39:00.768555 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c7d337b0-5597-482d-9f8a-9f1a8d8d794d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:39:00.778731 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:39:00.796102 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:39:00.796762 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:39:00.797732 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:39:00.798244 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:39:00.798746 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:39:00.799227 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] Filtering removed all hosts for the request with volume ID '7b79e572-7d3b-4fb4-b1fe-2908050675da'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:39:00.808555 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] Filtering removed all hosts for the request with volume ID '7b79e572-7d3b-4fb4-b1fe-2908050675da'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:39:00.809283 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:39:00.809734 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] Creating message record for request_id = req-dfa13817-8595-43bb-95f1-7c75309f9843 Jul 23 21:39:00.822879 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:39:00.823418 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] Setting Volume 7b79e572-7d3b-4fb4-b1fe-2908050675da to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:39:00.836514 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=74,cinder:UPDATE=15,cinder:INSERT=6,cinder:DELETE=5 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:00.844657 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c7d337b0-5597-482d-9f8a-9f1a8d8d794d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:39:00.847886 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dfa13817-8595-43bb-95f1-7c75309f9843 tempest-VolumesActionsTest-821932292 None] Flow 'volume_create_scheduler' (6086122d-aed5-494a-92e7-69231f52e39e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:39:07.512310 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-8dfea9d6-5d46-4906-a88a-4296b0786b9b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:39:08.886377 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] Flow 'volume_create_scheduler' (446eecb6-a416-4f53-be6a-762bef7e682e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:39:08.891094 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c2cdc788-b6ce-4b16-a326-594262a93116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:39:08.895656 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c2cdc788-b6ce-4b16-a326-594262a93116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b27b20aa-ef1b-4dd1-989e-321af6343d6a,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5429bb5d-3fdb-4050-9378-858e4ab66269),volume_id=5429bb5d-3fdb-4050-9378-858e4ab66269,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:39:08.899722 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (581a9a98-7854-4210-b849-d8a34a01d8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:39:08.913550 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:39:08.940385 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:39:08.940753 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:39:08.942990 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:39:08.946554 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:39:08.947156 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:39:08.947676 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] Filtering removed all hosts for the request with volume ID '5429bb5d-3fdb-4050-9378-858e4ab66269'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:39:08.949433 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] Filtering removed all hosts for the request with volume ID '5429bb5d-3fdb-4050-9378-858e4ab66269'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:39:08.950136 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:39:08.950738 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] Creating message record for request_id = req-5f913ef6-85cb-4061-866f-073bbb72bfb5 Jul 23 21:39:08.966230 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:39:08.966777 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] Setting Volume 5429bb5d-3fdb-4050-9378-858e4ab66269 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:39:08.985040 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (581a9a98-7854-4210-b849-d8a34a01d8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:39:09.001365 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5f913ef6-85cb-4061-866f-073bbb72bfb5 tempest-VolumesImageMetadata-1583226468 None] Flow 'volume_create_scheduler' (446eecb6-a416-4f53-be6a-762bef7e682e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:39:13.559593 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] Flow 'volume_create_scheduler' (5480dc2d-9c24-4975-b2a6-94983f6f0272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:39:13.566508 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (95a6f8fa-7ba3-4d83-96ce-f4a02912338d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:39:13.575730 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (95a6f8fa-7ba3-4d83-96ce-f4a02912338d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(347ae0ef-be3f-4556-86c9-7e83981d4dc1),volume_id=347ae0ef-be3f-4556-86c9-7e83981d4dc1,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:39:13.581885 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7d017cba-7990-42de-9881-39352a3209f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:39:13.595629 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:39:13.628420 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:39:13.628867 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:39:13.629383 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:39:13.629899 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:39:13.630439 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:39:13.630732 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] Filtering removed all hosts for the request with volume ID '347ae0ef-be3f-4556-86c9-7e83981d4dc1'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:39:13.631067 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] Filtering removed all hosts for the request with volume ID '347ae0ef-be3f-4556-86c9-7e83981d4dc1'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:39:13.631806 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:39:13.632411 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] Creating message record for request_id = req-167c50dd-74e7-475b-897c-a57f3a728602 Jul 23 21:39:13.654820 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:39:13.655196 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] Setting Volume 347ae0ef-be3f-4556-86c9-7e83981d4dc1 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:39:13.671038 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7d017cba-7990-42de-9881-39352a3209f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:39:13.674199 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-167c50dd-74e7-475b-897c-a57f3a728602 tempest-VolumesDeleteCascade-831573133 None] Flow 'volume_create_scheduler' (5480dc2d-9c24-4975-b2a6-94983f6f0272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:39:18.722053 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] Flow 'volume_create_scheduler' (1f5b7c6b-d38c-4caf-a2d1-5ee41d694cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:39:18.734258 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1e91fa12-f427-4549-8c81-0d37cd1eb776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:39:18.742318 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1e91fa12-f427-4549-8c81-0d37cd1eb776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(6e8c40b8-ad62-4a76-a2c2-d82403b17e04),volume_id=6e8c40b8-ad62-4a76-a2c2-d82403b17e04,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:39:18.750850 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d9d1f6c5-954a-47fb-a36e-6c805eb93283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:39:18.761168 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:39:18.794200 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:39:18.795458 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:39:18.795965 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:39:18.796642 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:39:18.797130 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:39:18.797695 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] Filtering removed all hosts for the request with volume ID '6e8c40b8-ad62-4a76-a2c2-d82403b17e04'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:39:18.798196 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] Filtering removed all hosts for the request with volume ID '6e8c40b8-ad62-4a76-a2c2-d82403b17e04'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:39:18.804622 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:39:18.808441 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] Creating message record for request_id = req-dd863928-d1f6-4626-9c32-4e89a3403b98 Jul 23 21:39:18.838940 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:39:18.840458 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] Setting Volume 6e8c40b8-ad62-4a76-a2c2-d82403b17e04 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:39:18.866040 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d9d1f6c5-954a-47fb-a36e-6c805eb93283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:39:18.880994 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-dd863928-d1f6-4626-9c32-4e89a3403b98 tempest-VolumesCloneNegativeTest-1120109416 None] Flow 'volume_create_scheduler' (1f5b7c6b-d38c-4caf-a2d1-5ee41d694cf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:39:23.105623 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] Flow 'volume_create_scheduler' (7d31f009-3041-459b-be99-1297b3c45cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:39:23.113251 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d996441c-3708-4c74-a1ee-8d39d428f55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:39:23.121285 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d996441c-3708-4c74-a1ee-8d39d428f55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2b94d46c-1cf3-45dc-96ea-46221314f110),volume_id=2b94d46c-1cf3-45dc-96ea-46221314f110,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:39:23.127717 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (900933cb-8743-4db0-9bfe-294ccca438a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:39:23.143178 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:39:23.169400 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:39:23.171516 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:39:23.172258 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:39:23.173031 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:39:23.173777 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:39:23.174723 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] Filtering removed all hosts for the request with volume ID '2b94d46c-1cf3-45dc-96ea-46221314f110'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:39:23.175598 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] Filtering removed all hosts for the request with volume ID '2b94d46c-1cf3-45dc-96ea-46221314f110'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:39:23.176642 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:39:23.177782 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] Creating message record for request_id = req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 Jul 23 21:39:23.192682 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:39:23.193534 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] Setting Volume 2b94d46c-1cf3-45dc-96ea-46221314f110 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:39:23.218044 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (900933cb-8743-4db0-9bfe-294ccca438a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:39:23.227764 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-21e2448f-5da4-4e77-89c7-f6f0d47c3322 tempest-VolumesNegativeTest-529788872 None] Flow 'volume_create_scheduler' (7d31f009-3041-459b-be99-1297b3c45cce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:39:32.844647 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=55,cinder:DELETE=5,cinder:UPDATE=11,cinder:INSERT=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:07.509471 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-f64d3c3b-1d5a-4298-bc87-ab6b58d310c8 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:40:12.853509 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:21.576157 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] Flow 'volume_create_scheduler' (45139fbe-0697-4d04-b4ca-f7aaccaf9e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:21.580443 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1b742fb8-e684-4156-a22a-1c4bc4679ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:21.584309 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1b742fb8-e684-4156-a22a-1c4bc4679ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f93b0912-113d-4bb8-b61a-bc02a55ef1cf),volume_id=f93b0912-113d-4bb8-b61a-bc02a55ef1cf,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:21.588923 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (69fb8132-c7cf-4999-8502-d3b4073df085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:21.609667 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:40:21.623182 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:40:21.623553 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:40:21.623904 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:21.624264 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:21.624585 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:21.624928 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] Filtering removed all hosts for the request with volume ID 'f93b0912-113d-4bb8-b61a-bc02a55ef1cf'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:40:21.625270 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] Filtering removed all hosts for the request with volume ID 'f93b0912-113d-4bb8-b61a-bc02a55ef1cf'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:40:21.626163 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:40:21.626585 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] Creating message record for request_id = req-73885a07-078b-4b3b-b693-e92f3a54cc35 Jul 23 21:40:21.634251 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:40:21.634625 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] Setting Volume f93b0912-113d-4bb8-b61a-bc02a55ef1cf to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:40:21.650266 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (69fb8132-c7cf-4999-8502-d3b4073df085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:21.654811 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-73885a07-078b-4b3b-b693-e92f3a54cc35 tempest-VolumesTransfersTest-1875231412 None] Flow 'volume_create_scheduler' (45139fbe-0697-4d04-b4ca-f7aaccaf9e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:22.901965 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] Flow 'volume_create_scheduler' (4481fcde-6de7-4193-830f-58600d7ba2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:22.911075 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (abbcd16c-c549-4feb-b5f3-02d49af2e3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:22.911170 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (abbcd16c-c549-4feb-b5f3-02d49af2e3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(6fb29e49-6cf8-4c22-8b30-f749e6383893),volume_id=6fb29e49-6cf8-4c22-8b30-f749e6383893,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:22.916481 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d041fc3e-efd4-4de4-a2bc-f7b6aaa3ae7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:22.925772 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:40:22.942851 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:40:22.943214 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:40:22.943559 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:22.943901 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:22.944296 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:22.944638 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] Filtering removed all hosts for the request with volume ID '6fb29e49-6cf8-4c22-8b30-f749e6383893'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:40:22.944971 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] Filtering removed all hosts for the request with volume ID '6fb29e49-6cf8-4c22-8b30-f749e6383893'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:40:22.945477 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:40:22.945910 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] Creating message record for request_id = req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 Jul 23 21:40:22.952602 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:40:22.953157 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] Setting Volume 6fb29e49-6cf8-4c22-8b30-f749e6383893 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:40:22.963684 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d041fc3e-efd4-4de4-a2bc-f7b6aaa3ae7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:22.966784 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-7eb3191b-55ae-4cf0-89eb-f32bd9f73639 tempest-VolumesTransfersTest-1875231412 None] Flow 'volume_create_scheduler' (4481fcde-6de7-4193-830f-58600d7ba2ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:23.761605 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-898111ea-4baf-4eff-87fb-6cca7eab6648 tempest-GroupsTest-337231764 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:40:23.768487 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-898111ea-4baf-4eff-87fb-6cca7eab6648 tempest-GroupsTest-337231764 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:40:23.769018 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.manager [None req-898111ea-4baf-4eff-87fb-6cca7eab6648 tempest-GroupsTest-337231764 None] Could not find a backend for group bd6739c3-5dd7-4dd2-920e-e4543a426367.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:40:25.219708 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-c1553e71-8676-4dfa-98d9-53a3e0d37d54 tempest-GroupsTest-337231764 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:40:25.227253 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-c1553e71-8676-4dfa-98d9-53a3e0d37d54 tempest-GroupsTest-337231764 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:40:25.227852 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.manager [None req-c1553e71-8676-4dfa-98d9-53a3e0d37d54 tempest-GroupsTest-337231764 None] Could not find a backend for group 9d2bcccf-a921-4f19-9c47-ba401e3e2a48.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:40:27.629061 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] Flow 'volume_create_scheduler' (55c0d0fe-5ecb-45ee-8542-36b2fd247b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:27.633560 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c573fb4e-3bae-45e6-8a8e-693ecb99a325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:27.637244 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c573fb4e-3bae-45e6-8a8e-693ecb99a325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bc3db935-de30-43d2-a80e-908d0256c336),volume_id=bc3db935-de30-43d2-a80e-908d0256c336,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:27.640691 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (132d34d0-d977-4d00-b52b-a210a9586849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:27.649588 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:40:27.672121 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:40:27.672487 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:40:27.673023 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:27.673372 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:27.673713 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:27.674083 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] Filtering removed all hosts for the request with volume ID 'bc3db935-de30-43d2-a80e-908d0256c336'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:40:27.674421 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] Filtering removed all hosts for the request with volume ID 'bc3db935-de30-43d2-a80e-908d0256c336'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:40:27.674902 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:40:27.675323 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] Creating message record for request_id = req-83c221ac-295a-47c6-b9d1-3fe39e89fedc Jul 23 21:40:27.683414 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:40:27.683643 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] Setting Volume bc3db935-de30-43d2-a80e-908d0256c336 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:40:27.697372 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (132d34d0-d977-4d00-b52b-a210a9586849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:27.700997 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-83c221ac-295a-47c6-b9d1-3fe39e89fedc tempest-VolumesSnapshotNegativeTestJSON-1847003677 None] Flow 'volume_create_scheduler' (55c0d0fe-5ecb-45ee-8542-36b2fd247b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:29.639616 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-4ea926ee-dfc9-4410-8e25-122323517351 tempest-GroupsV320Test-370275865 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:40:29.648758 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-4ea926ee-dfc9-4410-8e25-122323517351 tempest-GroupsV320Test-370275865 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:40:29.649292 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.manager [None req-4ea926ee-dfc9-4410-8e25-122323517351 tempest-GroupsV320Test-370275865 None] Could not find a backend for group 8380241a-6488-4d63-baf2-a0652a9ae440.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:40:35.517131 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] Flow 'volume_create_scheduler' (f31ca4a6-48d5-4043-8f89-84bc956c9c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:35.523981 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e60e1f89-2776-414e-bb31-50be9b1620d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:35.530148 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e60e1f89-2776-414e-bb31-50be9b1620d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(6d7e3caf-a2da-47c8-b119-e8d6df980430),volume_id=6d7e3caf-a2da-47c8-b119-e8d6df980430,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:35.536022 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (697a3dd9-6154-4fb9-819d-d1d1e3afceb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:35.545671 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:40:35.560419 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:40:35.560837 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:40:35.561633 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:35.562194 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:35.562823 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:35.563415 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] Filtering removed all hosts for the request with volume ID '6d7e3caf-a2da-47c8-b119-e8d6df980430'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:40:35.563836 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] Filtering removed all hosts for the request with volume ID '6d7e3caf-a2da-47c8-b119-e8d6df980430'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:40:35.564374 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:40:35.566010 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] Creating message record for request_id = req-323a5347-818a-463c-90e2-ce4373f1de56 Jul 23 21:40:35.573703 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:40:35.574071 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] Setting Volume 6d7e3caf-a2da-47c8-b119-e8d6df980430 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:40:35.585924 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (697a3dd9-6154-4fb9-819d-d1d1e3afceb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:35.589333 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-323a5347-818a-463c-90e2-ce4373f1de56 tempest-SnapshotMetadataTestJSON-2133323090 None] Flow 'volume_create_scheduler' (f31ca4a6-48d5-4043-8f89-84bc956c9c07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:39.258883 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] Flow 'volume_create_scheduler' (163ca038-7e12-48d9-8130-a8c9e60200cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:39.263669 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6dbbbb9b-3cec-416e-a91c-c70b2fec4e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:39.269069 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6dbbbb9b-3cec-416e-a91c-c70b2fec4e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a05fc90d-a2d4-4d2f-bb02-ddefec4a0ef1),volume_id=a05fc90d-a2d4-4d2f-bb02-ddefec4a0ef1,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:39.272884 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (dda9dfd7-ce04-4536-ad06-3ea4be18813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:39.284368 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:40:39.317205 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:40:39.317205 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:40:39.317205 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:39.317205 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:39.320499 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:39.321098 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] Filtering removed all hosts for the request with volume ID 'a05fc90d-a2d4-4d2f-bb02-ddefec4a0ef1'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:40:39.321610 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] Filtering removed all hosts for the request with volume ID 'a05fc90d-a2d4-4d2f-bb02-ddefec4a0ef1'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:40:39.326844 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:40:39.327449 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] Creating message record for request_id = req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e Jul 23 21:40:39.331055 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=76,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:39.350155 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:40:39.350637 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] Setting Volume a05fc90d-a2d4-4d2f-bb02-ddefec4a0ef1 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:40:39.376468 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (dda9dfd7-ce04-4536-ad06-3ea4be18813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:39.389067 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2a39ca2c-6722-4bcb-bfe7-1bf7d5db162e tempest-VolumesBackupsV39Test-937418064 None] Flow 'volume_create_scheduler' (163ca038-7e12-48d9-8130-a8c9e60200cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:42.566508 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] Flow 'volume_create_scheduler' (a6e378b0-8f1f-4ebc-bd68-5721c44a5c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:42.575466 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e72b329d-ec72-4161-8e41-d33d005ef307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:42.580211 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e72b329d-ec72-4161-8e41-d33d005ef307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a6b65555-040f-40f2-bcd3-04e6ffa91ee8),volume_id=a6b65555-040f-40f2-bcd3-04e6ffa91ee8,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:42.584191 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c670d9d7-b10e-4e5f-8141-a62b06844e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:42.596067 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:40:42.612132 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:40:42.612668 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:40:42.613112 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:42.613565 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:42.614057 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:42.614525 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] Filtering removed all hosts for the request with volume ID 'a6b65555-040f-40f2-bcd3-04e6ffa91ee8'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:40:42.614966 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] Filtering removed all hosts for the request with volume ID 'a6b65555-040f-40f2-bcd3-04e6ffa91ee8'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:40:42.615545 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:40:42.616108 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] Creating message record for request_id = req-c8168552-24f1-40e2-ab9e-f7fce52e46eb Jul 23 21:40:42.624932 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:40:42.625574 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] Setting Volume a6b65555-040f-40f2-bcd3-04e6ffa91ee8 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:40:42.639566 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c670d9d7-b10e-4e5f-8141-a62b06844e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:42.642657 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-c8168552-24f1-40e2-ab9e-f7fce52e46eb tempest-VolumesGetTest-1244904836 None] Flow 'volume_create_scheduler' (a6e378b0-8f1f-4ebc-bd68-5721c44a5c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:44.070259 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] Flow 'volume_create_scheduler' (3b9973df-3795-4b34-8030-66028f0a8eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:44.074552 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e18d0c3b-975f-4eba-9f09-3bd2ddb09515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:44.078516 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e18d0c3b-975f-4eba-9f09-3bd2ddb09515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8c707434-f9ab-439d-b72d-a7afd914fc0b),volume_id=8c707434-f9ab-439d-b72d-a7afd914fc0b,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:44.081805 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (174b066b-f706-4f0d-8745-6a825f7598f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:44.098228 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:40:44.104884 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:40:44.105198 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:40:44.105554 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:44.105924 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:44.106270 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:44.106623 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] Filtering removed all hosts for the request with volume ID '8c707434-f9ab-439d-b72d-a7afd914fc0b'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:40:44.106967 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] Filtering removed all hosts for the request with volume ID '8c707434-f9ab-439d-b72d-a7afd914fc0b'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:40:44.107446 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:40:44.107864 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] Creating message record for request_id = req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd Jul 23 21:40:44.115230 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:40:44.115688 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] Setting Volume 8c707434-f9ab-439d-b72d-a7afd914fc0b to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:40:44.126340 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (174b066b-f706-4f0d-8745-6a825f7598f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:44.129452 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-5cf7ea11-66eb-4afd-9cac-f709018f4fdd tempest-VolumesGetTest-1244904836 None] Flow 'volume_create_scheduler' (3b9973df-3795-4b34-8030-66028f0a8eaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:45.548570 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] Flow 'volume_create_scheduler' (d479b327-d8f7-41a3-8d8a-0e19f325a333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:45.553514 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1a5b38ea-0d1d-432f-8d0e-46ade07f1a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:45.558183 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1a5b38ea-0d1d-432f-8d0e-46ade07f1a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b27b20aa-ef1b-4dd1-989e-321af6343d6a,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f85ba2fd-ead1-4e4a-9d58-468007c9912c),volume_id=f85ba2fd-ead1-4e4a-9d58-468007c9912c,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:45.561797 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (be760d4e-2dc6-4a3e-ae20-bcf13537c228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:45.571340 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:40:45.585897 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:40:45.586306 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:40:45.586659 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:45.587006 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:45.587345 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:45.587688 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] Filtering removed all hosts for the request with volume ID 'f85ba2fd-ead1-4e4a-9d58-468007c9912c'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:40:45.588030 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] Filtering removed all hosts for the request with volume ID 'f85ba2fd-ead1-4e4a-9d58-468007c9912c'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:40:45.588512 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:40:45.588934 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] Creating message record for request_id = req-f9e52f20-745d-4bb9-a76f-132328705973 Jul 23 21:40:45.595448 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:40:45.595894 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] Setting Volume f85ba2fd-ead1-4e4a-9d58-468007c9912c to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:40:45.606093 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (be760d4e-2dc6-4a3e-ae20-bcf13537c228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:45.609516 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-f9e52f20-745d-4bb9-a76f-132328705973 tempest-VolumesGetTest-1244904836 None] Flow 'volume_create_scheduler' (d479b327-d8f7-41a3-8d8a-0e19f325a333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:48.721806 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] Flow 'volume_create_scheduler' (fbcb72ec-c9ee-4cce-ad88-b78d93f3f3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:40:48.726905 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3dca7d2a-0cf5-4cd3-946c-c5a7cdb685a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:48.731260 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3dca7d2a-0cf5-4cd3-946c-c5a7cdb685a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(d78432f5-c341-4023-b38e-3af8376ad6d7),volume_id=d78432f5-c341-4023-b38e-3af8376ad6d7,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:48.734783 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c9159985-f7a5-4ae4-aa06-9c88b8c4552d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:40:48.743198 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:40:48.757180 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:40:48.757566 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:40:48.758000 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:48.758364 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:48.758701 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:40:48.759039 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] Filtering removed all hosts for the request with volume ID 'd78432f5-c341-4023-b38e-3af8376ad6d7'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:40:48.759373 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] Filtering removed all hosts for the request with volume ID 'd78432f5-c341-4023-b38e-3af8376ad6d7'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:40:48.759847 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:40:48.760256 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] Creating message record for request_id = req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 Jul 23 21:40:48.769368 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:40:48.769740 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] Setting Volume d78432f5-c341-4023-b38e-3af8376ad6d7 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:40:48.781084 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c9159985-f7a5-4ae4-aa06-9c88b8c4552d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:40:48.784222 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-0a2eb0e1-e47e-4728-bd57-de7a54a18315 tempest-VolumesListTestJSON-288709979 None] Flow 'volume_create_scheduler' (fbcb72ec-c9ee-4cce-ad88-b78d93f3f3e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:41:07.502670 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-05bee121-a38f-43f8-99c7-8f4a861cbdaa None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:41:12.875224 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=56,cinder:UPDATE=12,cinder:DELETE=5,cinder:INSERT=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:20.146583 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] Flow 'volume_create_scheduler' (0c2009dc-d6ac-49f3-98e9-12512f16c10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:41:20.151751 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (df2a11fe-da52-45d6-aa9b-e73b95140312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:41:20.156033 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (df2a11fe-da52-45d6-aa9b-e73b95140312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b27b20aa-ef1b-4dd1-989e-321af6343d6a,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f0099bef-64ea-4fb6-9bfb-45005eb2f1d2),volume_id=f0099bef-64ea-4fb6-9bfb-45005eb2f1d2,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:41:20.159643 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0b4e9718-759e-4a39-83ac-7ba90ade2e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 21:41:20.168580 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:41:20.183847 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 21:41:20.184208 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 21:41:20.184557 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:41:20.184898 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:41:20.185237 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 21:41:20.185576 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] Filtering removed all hosts for the request with volume ID 'f0099bef-64ea-4fb6-9bfb-45005eb2f1d2'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 21:41:20.185939 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] Filtering removed all hosts for the request with volume ID 'f0099bef-64ea-4fb6-9bfb-45005eb2f1d2'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 21:41:20.186438 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 21:41:20.186825 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] Creating message record for request_id = req-d2cfad2f-5d33-49eb-86d8-74054af5632f Jul 23 21:41:20.195186 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 21:41:20.195593 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] Setting Volume f0099bef-64ea-4fb6-9bfb-45005eb2f1d2 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 21:41:20.208965 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0b4e9718-759e-4a39-83ac-7ba90ade2e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 21:41:20.212701 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d2cfad2f-5d33-49eb-86d8-74054af5632f tempest-TestVolumeBackupRestore-318981042 None] Flow 'volume_create_scheduler' (0c2009dc-d6ac-49f3-98e9-12512f16c10c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 21:41:52.867383 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:42:07.504269 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-71348f53-5f5f-4f35-ab58-84b9208ab800 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:42:32.871148 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:43:02.880514 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:43:07.500107 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-929f60af-37ff-498a-a770-51674b353792 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:43:42.895986 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:44:07.507845 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-75af3a8d-fb4b-478b-b293-37b7922dff7e None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:44:22.898475 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:44:52.913672 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:45:07.506188 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-0e62fc71-3b34-49c2-8835-3f80330bd0a8 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:45:32.901494 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:46:07.505312 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-3112893c-e2e5-48d3-ad3f-619ffbdda312 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:46:12.894162 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:46:52.894127 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:47:07.502538 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-a7a8294c-68bc-44a8-b5e3-408b8ab288e4 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:47:32.899764 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:48:02.916970 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:48:07.498932 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-1db68e5b-7878-4786-a4e6-8a146b2a224b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:48:42.906545 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:49:07.498920 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-886f328f-5be8-459b-9e80-2953b277ed68 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:49:22.903260 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:49:52.918838 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:50:07.498253 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-79983ea8-5eb7-4ba5-a657-198a6bd5a4c3 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:50:32.909794 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:51:07.495694 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-5bfbca88-6b9a-45b4-b5ea-3d2f92a47ad9 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:51:12.916854 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:51:32.927562 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:52:02.946752 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:52:07.492237 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-9e1681ef-84bf-4405-ab70-ac056617fca4 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:52:42.945936 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:53:07.497956 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-3792d4c4-ce0f-4a38-8ee1-61fd0a00283b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:53:12.960665 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:53:52.954613 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:54:07.506920 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-f814fb57-6f5a-4668-a1ed-6b0a89951b62 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:54:22.969815 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:54:52.978183 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=3,cinder:SELECT=8 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:55:07.501629 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-22d57fb4-5820-4980-a414-367e97f3bc66 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:55:32.986396 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:56:02.997297 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:56:07.499551 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-87fa9d42-cbd7-4dee-899a-53b2bc3c3b3e None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:56:42.995691 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:57:07.496148 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-3de44c91-9c0e-4d63-b474-7aa25fa23525 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:57:22.996615 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:57:53.010544 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:58:23.020080 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:59:03.018537 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:59:07.496189 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-1f2a0c81-4398-4f5e-858b-9dcc2db884b1 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 21:59:43.026592 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:07.491992 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-75d16621-b8b5-4f05-8c69-8d824ff121d2 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:00:13.037812 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:53.042398 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:07.490432 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-b9d6c1d0-85c5-4498-afc6-97539e41a56b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:01:33.049569 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:03.068195 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:07.496759 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-e6d4af92-0081-4e1f-82dd-62ba6fa2456d None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:02:33.077296 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:03:03.085096 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:03:07.496271 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-66b99668-0084-427e-b230-48f617e66156 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:03:33.088391 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:07.495785 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-3a82ba3e-9435-422c-b55e-17e81110c497 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:04:13.099380 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:39.138800 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-b6538edd-0fb5-4422-89a5-2facc5dde0e8 tempest-BackendsCapabilitiesAdminTestsJSON-872718096 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 22:04:39.169181 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-8c2c6b27-82f7-48b4-9f7a-d783e1a748a6 tempest-BackendsCapabilitiesAdminTestsJSON-872718096 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 22:04:42.058734 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-8e42da76-2858-44eb-b325-9a35e04e0013 tempest-GroupSnapshotsV319Test-362077768 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 22:04:42.064825 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-8e42da76-2858-44eb-b325-9a35e04e0013 tempest-GroupSnapshotsV319Test-362077768 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 22:04:42.065360 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.manager [None req-8e42da76-2858-44eb-b325-9a35e04e0013 tempest-GroupSnapshotsV319Test-362077768 None] Could not find a backend for group f2a51256-cbfa-450b-8ad0-429701a0efd0.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 22:04:53.107197 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=21,cinder:UPDATE=5 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:04:53.376328 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] Flow 'volume_create_scheduler' (7deb4c38-74b5-4715-a39a-1244f48be19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:04:53.380511 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (023a6345-97d4-459a-80ec-0194228b59db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:04:53.384328 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (023a6345-97d4-459a-80ec-0194228b59db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f8c61e17-823e-48ec-b9f7-e7efd87e19cb),volume_id=f8c61e17-823e-48ec-b9f7-e7efd87e19cb,volume_properties=VolumeProperties,volume_type=VolumeType(9e5483d2-49f8-42b3-96d1-ecf674358c8f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:04:53.387741 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ead825e8-3f73-4de7-af73-9a0d8abf0dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:04:53.396921 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 22:04:53.411326 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 22:04:53.411695 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 22:04:53.412058 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:04:53.412411 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:04:53.412753 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:04:53.413101 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] Filtering removed all hosts for the request with volume ID 'f8c61e17-823e-48ec-b9f7-e7efd87e19cb'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 22:04:53.413441 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] Filtering removed all hosts for the request with volume ID 'f8c61e17-823e-48ec-b9f7-e7efd87e19cb'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 22:04:53.414028 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] No weighed backend found for volume with properties: {'id': '9e5483d2-49f8-42b3-96d1-ecf674358c8f', 'name': 'volume-type-1', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {}, 'qos_specs_id': None, 'created_at': '2022-07-23T22:04:53.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 22:04:53.414476 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] Creating message record for request_id = req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 Jul 23 22:04:53.422247 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 22:04:53.422618 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] Setting Volume f8c61e17-823e-48ec-b9f7-e7efd87e19cb to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 22:04:53.433332 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ead825e8-3f73-4de7-af73-9a0d8abf0dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:04:53.436496 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-e2dacaf3-86ad-4b9d-b6a4-4fbb887b4e07 tempest-VolumeRetypeWithoutMigrationTest-774129464 None] Flow 'volume_create_scheduler' (7deb4c38-74b5-4715-a39a-1244f48be19d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:04:57.017240 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] Flow 'volume_create_scheduler' (e5954e4e-c150-48ba-9c59-efbd1a929225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:04:57.021332 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (eaf862b0-ade3-41a8-83c7-e773f2d24d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:04:57.025088 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (eaf862b0-ade3-41a8-83c7-e773f2d24d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(d1387e33-012f-48f2-b600-7d3f7ce25e11),volume_id=d1387e33-012f-48f2-b600-7d3f7ce25e11,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:04:57.028406 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1bd6b81f-c49f-4f83-8d6d-ab6a44068017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:04:57.037456 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 22:04:57.055792 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 22:04:57.056152 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 22:04:57.056494 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:04:57.056833 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:04:57.057178 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:04:57.057509 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] Filtering removed all hosts for the request with volume ID 'd1387e33-012f-48f2-b600-7d3f7ce25e11'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 22:04:57.057844 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] Filtering removed all hosts for the request with volume ID 'd1387e33-012f-48f2-b600-7d3f7ce25e11'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 22:04:57.058457 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 22:04:57.058866 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] Creating message record for request_id = req-2242ba4b-6337-4674-a76f-91d348bee1db Jul 23 22:04:57.066046 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 22:04:57.066439 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] Setting Volume d1387e33-012f-48f2-b600-7d3f7ce25e11 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 22:04:57.076685 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1bd6b81f-c49f-4f83-8d6d-ab6a44068017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:04:57.079766 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-2242ba4b-6337-4674-a76f-91d348bee1db tempest-VolumesSnapshotListTestJSON-935010984 None] Flow 'volume_create_scheduler' (e5954e4e-c150-48ba-9c59-efbd1a929225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:05:07.501816 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-d110cc64-10af-4e30-a141-887e2c45ea57 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:05:23.119607 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=33,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:06:03.127180 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:06:07.503210 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-830996dd-9af2-40f5-b85f-b78613e149e4 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:06:33.140971 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:07.502139 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-1311b99e-eb82-43c5-94a7-0fb85e7877ff None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:07:13.141931 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:53.148382 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:07.501892 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-ed83d8d3-105a-4788-8c6b-6353b69e9c36 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:08:21.943958 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] Flow 'volume_create_scheduler' (29a9dc2a-81d1-4c43-81e8-17dc887c1bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:08:21.948889 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (86a6305a-2692-49cb-a9ae-f52b01ab20b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:08:21.952985 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (86a6305a-2692-49cb-a9ae-f52b01ab20b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b27b20aa-ef1b-4dd1-989e-321af6343d6a,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(78cd6be4-89b5-4e62-9a52-fdc3aa6d64d6),volume_id=78cd6be4-89b5-4e62-9a52-fdc3aa6d64d6,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:08:21.957455 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6a4f9dfd-7ead-4b86-87e5-12e45d3870e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:08:21.966600 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 22:08:21.981472 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 22:08:21.981980 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 22:08:21.982520 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:08:21.982958 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:08:21.983386 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:08:21.983831 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] Filtering removed all hosts for the request with volume ID '78cd6be4-89b5-4e62-9a52-fdc3aa6d64d6'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 22:08:21.984251 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] Filtering removed all hosts for the request with volume ID '78cd6be4-89b5-4e62-9a52-fdc3aa6d64d6'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 22:08:21.984809 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 22:08:21.985478 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] Creating message record for request_id = req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f Jul 23 22:08:21.993878 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 22:08:21.994321 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] Setting Volume 78cd6be4-89b5-4e62-9a52-fdc3aa6d64d6 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 22:08:22.006228 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6a4f9dfd-7ead-4b86-87e5-12e45d3870e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:08:22.009366 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-44d1e8b2-f709-43f5-9cfc-39743b92ea2f tempest-TestVolumeBootPattern-1199428530 None] Flow 'volume_create_scheduler' (29a9dc2a-81d1-4c43-81e8-17dc887c1bb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:08:23.158343 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=22,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:23.566228 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] Flow 'volume_create_scheduler' (a474cb7c-88b9-4f62-92f2-215b26a22beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:08:23.570382 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ec25d575-d69a-4cf3-a7e3-115cf1c55730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:08:23.574216 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ec25d575-d69a-4cf3-a7e3-115cf1c55730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b27b20aa-ef1b-4dd1-989e-321af6343d6a,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(1a9cba26-5757-46f8-b754-84b70d483fb9),volume_id=1a9cba26-5757-46f8-b754-84b70d483fb9,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:08:23.577591 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (096f952c-ea71-4d6b-8070-2adce66832f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:08:23.586567 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 22:08:23.600256 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 22:08:23.600622 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 22:08:23.601011 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:08:23.601310 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:08:23.601642 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:08:23.602012 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] Filtering removed all hosts for the request with volume ID '1a9cba26-5757-46f8-b754-84b70d483fb9'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 22:08:23.602354 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] Filtering removed all hosts for the request with volume ID '1a9cba26-5757-46f8-b754-84b70d483fb9'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 22:08:23.602831 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 22:08:23.603313 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] Creating message record for request_id = req-83191ef6-7a31-4b79-bfab-4a3291db2d87 Jul 23 22:08:23.610972 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 22:08:23.611390 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] Setting Volume 1a9cba26-5757-46f8-b754-84b70d483fb9 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 22:08:23.622878 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (096f952c-ea71-4d6b-8070-2adce66832f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:08:23.625975 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-83191ef6-7a31-4b79-bfab-4a3291db2d87 tempest-TestVolumeBootPattern-1199428530 None] Flow 'volume_create_scheduler' (a474cb7c-88b9-4f62-92f2-215b26a22beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:08:26.600365 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] Flow 'volume_create_scheduler' (1f9e15fb-6cac-402b-81bd-8323a827f01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:08:26.604652 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (103fef48-6641-4fc8-b9f1-638a0ed91b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:08:26.608872 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (103fef48-6641-4fc8-b9f1-638a0ed91b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b27b20aa-ef1b-4dd1-989e-321af6343d6a,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7c5b86ef-1efc-4460-af38-7cd8533ce6e4),volume_id=7c5b86ef-1efc-4460-af38-7cd8533ce6e4,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:08:26.612149 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fed2bf07-dd86-459b-95da-8412f394968a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:08:26.621701 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 22:08:26.635895 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 22:08:26.636258 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 22:08:26.636610 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:08:26.636950 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:08:26.637285 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:08:26.637621 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] Filtering removed all hosts for the request with volume ID '7c5b86ef-1efc-4460-af38-7cd8533ce6e4'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 22:08:26.638003 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] Filtering removed all hosts for the request with volume ID '7c5b86ef-1efc-4460-af38-7cd8533ce6e4'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 22:08:26.638470 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 22:08:26.638883 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] Creating message record for request_id = req-62118e60-bfd6-49b5-9006-722482a05c32 Jul 23 22:08:26.646572 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 22:08:26.646946 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] Setting Volume 7c5b86ef-1efc-4460-af38-7cd8533ce6e4 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 22:08:26.657008 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fed2bf07-dd86-459b-95da-8412f394968a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:08:26.660092 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-62118e60-bfd6-49b5-9006-722482a05c32 tempest-TestVolumeBootPattern-1199428530 None] Flow 'volume_create_scheduler' (1f9e15fb-6cac-402b-81bd-8323a827f01e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:08:53.175084 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=7,cinder:SELECT=31,cinder:INSERT=2,cinder:DELETE=2 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:09:07.498585 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-09da6c1a-3892-41b9-80b5-4beddb347d18 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:09:33.170574 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:03.185740 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:07.497372 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-9f6c221c-1804-48c3-8f21-53fa947044ec None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:10:43.189805 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:07.505129 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-caeacdc7-c19a-4c77-b484-a84c10f5151b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:11:13.206419 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:53.216847 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:12:07.502737 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-7895b40f-2422-4f61-8eb4-871b596bf717 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:12:33.222812 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:13:03.236409 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:13:07.502872 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-bc3ef6e2-4f64-45aa-80f7-fb7758bf7632 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:13:43.234098 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:14:07.496956 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-f41d561a-2ff7-4855-a52a-1dc65541da2c None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:14:23.234314 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:15:03.238558 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:15:07.505074 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-dadbd1a5-261a-45bf-8411-a61158444f34 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:15:33.250162 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:16:07.504097 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-9ee6afd2-e570-4f1d-a52c-8c0fda2e7d86 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:16:13.247997 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:16:22.682239 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] Flow 'volume_create_scheduler' (9682de74-1dcd-4f56-9a13-0ba6ed2682a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:16:22.686214 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (163d6032-d6c2-4eb1-a997-afa12af9ed17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:16:22.690042 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (163d6032-d6c2-4eb1-a997-afa12af9ed17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4b23cfe7-f2a2-4901-b8f1-db4544af4d75),volume_id=4b23cfe7-f2a2-4901-b8f1-db4544af4d75,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:16:22.693697 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a4cf8a5c-03fa-41fa-b1f1-02e57741f3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:16:22.703264 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 22:16:22.716595 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 22:16:22.716951 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 22:16:22.717292 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:16:22.717660 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:16:22.718024 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:16:22.718358 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] Filtering removed all hosts for the request with volume ID '4b23cfe7-f2a2-4901-b8f1-db4544af4d75'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 22:16:22.718687 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] Filtering removed all hosts for the request with volume ID '4b23cfe7-f2a2-4901-b8f1-db4544af4d75'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 22:16:22.719151 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 22:16:22.719555 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] Creating message record for request_id = req-3026d635-5cd9-406f-a45f-99a5d20541b2 Jul 23 22:16:22.726851 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 22:16:22.727205 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] Setting Volume 4b23cfe7-f2a2-4901-b8f1-db4544af4d75 to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 22:16:22.738348 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a4cf8a5c-03fa-41fa-b1f1-02e57741f3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:16:22.741380 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-3026d635-5cd9-406f-a45f-99a5d20541b2 tempest-ServerActionsTestJSON-1436267344 None] Flow 'volume_create_scheduler' (9682de74-1dcd-4f56-9a13-0ba6ed2682a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:16:43.265518 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=22,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:07.501770 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-c57b48b0-5586-4242-a4e0-82beebad3c0a None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:17:23.270183 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:53.280406 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:06.116910 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] Flow 'volume_create_scheduler' (e05c905e-55a0-45b8-a9b5-d79fb5e29164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:18:06.120953 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3618784d-3967-4081-acd3-13465f6b4692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:18:06.124947 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3618784d-3967-4081-acd3-13465f6b4692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b98dc01c-c02e-4c6c-b617-89914bd4d47f),volume_id=b98dc01c-c02e-4c6c-b617-89914bd4d47f,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:18:06.128337 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (aa2adeb6-bcd8-4758-8e39-334825a371f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:18:06.142325 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 22:18:06.157490 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 22:18:06.157872 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 22:18:06.158232 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:18:06.158585 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:18:06.158926 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:18:06.159274 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] Filtering removed all hosts for the request with volume ID 'b98dc01c-c02e-4c6c-b617-89914bd4d47f'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 22:18:06.159609 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] Filtering removed all hosts for the request with volume ID 'b98dc01c-c02e-4c6c-b617-89914bd4d47f'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 22:18:06.160109 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 22:18:06.160539 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] Creating message record for request_id = req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 Jul 23 22:18:06.167627 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 22:18:06.167997 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] Setting Volume b98dc01c-c02e-4c6c-b617-89914bd4d47f to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 22:18:06.178520 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (aa2adeb6-bcd8-4758-8e39-334825a371f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:18:06.181587 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-d6ad6280-a55d-4675-a00b-3f5ad4e78a90 tempest-TestMinimumBasicScenario-1035013710 None] Flow 'volume_create_scheduler' (e05c905e-55a0-45b8-a9b5-d79fb5e29164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:18:07.496643 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-63b419b1-5dc7-4bc9-8136-00414f0dbba4 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:18:33.277537 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:37.799362 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] Flow 'volume_create_scheduler' (57d65943-9d78-43a1-9b75-ad17b5be0acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:18:37.803391 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f0fa3732-1f88-4cf5-966d-759a6171263b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:18:37.807128 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f0fa3732-1f88-4cf5-966d-759a6171263b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f203fef9-2873-478a-ab70-b0c5bd15214b),volume_id=f203fef9-2873-478a-ab70-b0c5bd15214b,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:18:37.810431 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ef1c6867-0ac5-47e4-bea8-394fe55880ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:18:37.820702 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 22:18:37.834790 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 22:18:37.835148 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 22:18:37.835476 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:18:37.835811 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:18:37.836149 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:18:37.836481 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] Filtering removed all hosts for the request with volume ID 'f203fef9-2873-478a-ab70-b0c5bd15214b'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 22:18:37.836798 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] Filtering removed all hosts for the request with volume ID 'f203fef9-2873-478a-ab70-b0c5bd15214b'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 22:18:37.837312 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 22:18:37.837721 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] Creating message record for request_id = req-29df3524-8842-474b-af23-3b01f87b69fd Jul 23 22:18:37.845170 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 22:18:37.845528 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] Setting Volume f203fef9-2873-478a-ab70-b0c5bd15214b to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 22:18:37.855618 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ef1c6867-0ac5-47e4-bea8-394fe55880ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:18:37.858728 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-29df3524-8842-474b-af23-3b01f87b69fd tempest-TestMinimumBasicScenario-1035013710 None] Flow 'volume_create_scheduler' (57d65943-9d78-43a1-9b75-ad17b5be0acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:19:07.502567 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-ca23fc86-cdfc-42af-96e2-dc01f724ecac None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:19:13.293040 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:19:53.310099 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:20:07.510860 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-f28a63e6-f2b3-4dde-a551-54a56f3a80bf None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:20:23.326083 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:21:03.332804 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:21:07.514029 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-59617f17-91e7-484c-97de-83b542e3e072 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:21:43.340082 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:22:07.510068 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-be3cd50e-fadd-4143-890b-2e09d1c81724 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:22:23.339203 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:22:53.352922 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:23:07.509376 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-923d535f-0350-462e-84b9-9f4c0a989a80 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:23:23.367241 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:24:03.371720 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:24:07.509202 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-d64b5dd2-320a-481f-86ff-f5c07ee2d7d5 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:24:43.386524 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:25:07.507761 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-b7c2ad37-b8d2-44a7-9437-57ae2b746447 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:25:13.400153 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:25:53.398169 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:07.506910 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-b73aa29d-cd34-435d-8ad9-1190230104f0 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:26:23.414119 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:43.419829 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:27:03.426091 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:27:07.506253 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-a41907e9-1667-406a-a8b6-a6b8cbea48c6 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:27:33.436507 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:28:07.506479 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-79ba8302-f1d2-4c32-bf51-98dab9d72233 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:28:13.433241 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:28:43.451026 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:29:07.501711 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-ebc78f82-08ba-4913-ae1c-9bcd1cc5aaa3 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:29:13.460730 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:29:53.451004 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:30:07.501674 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-8d01486d-575c-49be-ae38-7e3d89347829 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:30:23.467990 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:30:49.465247 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] Flow 'volume_create_scheduler' (db8f2024-1eb3-4621-898b-85e08026d449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:30:49.470091 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1d7a66d5-6093-4e48-8e5e-53f9ba14d8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:30:49.473889 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1d7a66d5-6093-4e48-8e5e-53f9ba14d8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b27b20aa-ef1b-4dd1-989e-321af6343d6a,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(eb208ced-8ed2-46da-888b-b9f7c3de308b),volume_id=eb208ced-8ed2-46da-888b-b9f7c3de308b,volume_properties=VolumeProperties,volume_type=VolumeType(4aa3bb33-251c-4cce-a566-17b811da923f))}' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:30:49.477199 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9e258993-8619-4903-8d99-c5063369d6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Jul 23 22:30:49.486581 ncdv-master-1 cinder-scheduler[123551]: DEBUG oslo_db.sqlalchemy.engines [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123551) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 22:30:49.500445 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.host_manager [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] volume service is down. (host: ncdv-master-1@ceph) Jul 23 22:30:49.500806 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] Starting with 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Jul 23 22:30:49.501156 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:30:49.501499 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] Filter CapacityFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:30:49.501839 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=123551) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Jul 23 22:30:49.502244 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.base_filter [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] Filtering removed all hosts for the request with volume ID 'eb208ced-8ed2-46da-888b-b9f7c3de308b'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=123551) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Jul 23 22:30:49.502578 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.scheduler.base_filter [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] Filtering removed all hosts for the request with volume ID 'eb208ced-8ed2-46da-888b-b9f7c3de308b'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Jul 23 22:30:49.503058 ncdv-master-1 cinder-scheduler[123551]: WARNING cinder.scheduler.filter_scheduler [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] No weighed backend found for volume with properties: {'id': '4aa3bb33-251c-4cce-a566-17b811da923f', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-07-23T21:04:12.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Jul 23 22:30:49.503476 ncdv-master-1 cinder-scheduler[123551]: INFO cinder.message.api [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] Creating message record for request_id = req-713c41c6-7ed6-4410-8aab-8a1c49532a17 Jul 23 22:30:49.510956 ncdv-master-1 cinder-scheduler[123551]: ERROR cinder.scheduler.flows.create_volume [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Jul 23 22:30:49.511318 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.volume.flows.common [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] Setting Volume eb208ced-8ed2-46da-888b-b9f7c3de308b to error due to: No valid backend was found. No weighed backends available {{(pid=123551) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Jul 23 22:30:49.522008 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9e258993-8619-4903-8d99-c5063369d6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=123551) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Jul 23 22:30:49.525146 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.manager [None req-713c41c6-7ed6-4410-8aab-8a1c49532a17 tempest-TestShelveInstance-945555474 None] Flow 'volume_create_scheduler' (db8f2024-1eb3-4621-898b-85e08026d449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=123551) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Jul 23 22:31:03.472031 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=6,cinder:SELECT=21,cinder:INSERT=1,cinder:DELETE=1 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:31:07.504083 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-87cf7a2a-4eb0-4e5e-a944-768a3d465318 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:31:33.490196 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:32:03.501788 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:32:07.506841 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-52921b26-9882-4958-8c18-6c360439bf46 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:32:43.503819 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:33:07.508698 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-e73bbc59-4994-4dc8-96f9-d29b8a34f5d9 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:33:13.525843 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:33:53.522262 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:34:07.506195 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-21d0421e-c99c-4b4d-845e-800ccd449335 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:34:23.533430 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:35:03.534483 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:35:07.504904 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-80e63a90-f034-43d5-9c06-f7bb6c0546cc None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:35:33.548915 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:36:07.504095 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-437a9611-7a73-40ec-b924-bab8c4c31664 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:36:13.544217 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:36:43.561285 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:37:07.503469 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-6bb4b379-22db-43d5-8630-51e14f20eca9 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:37:23.555970 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:37:53.569347 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:38:07.500319 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-eaf8594a-0484-45bd-90d1-a0ce6780251d None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:38:23.584936 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:39:03.587156 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:39:07.497224 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-6ea493a2-84f7-4cea-8bdd-354e59b46e74 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:39:43.591225 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:40:07.496007 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-40b972ed-a35a-43bf-8b9e-6299284f40cc None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:40:13.611231 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:40:53.610135 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:41:07.494650 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-b1b057e1-6f1c-4973-8019-cf1edfd052a9 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:41:23.627893 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:41:53.636694 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:42:07.494700 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-3b2d622b-bf0c-4c9d-aa45-eb9b368c42f1 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Jul 23 22:42:33.631057 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:43:03.647945 ncdv-master-1 cinder-scheduler[123551]: DEBUG dbcounter [-] [123551] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=123551) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:43:07.492747 ncdv-master-1 cinder-scheduler[123551]: DEBUG cinder.scheduler.host_manager [None req-483f908d-478e-4ed9-a711-b4d0d02e1ba2 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=123551) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}}