-- Logs begin at Sat 2022-08-20 20:01:16 UTC, end at Sat 2022-08-20 22:15:17 UTC. -- Aug 20 20:45:24.376169 ncdv-master-1 systemd[1]: Started Devstack devstack@c-sch.service. Aug 20 20:45:27.920660 ncdv-master-1 cinder-scheduler[137470]: INFO dbcounter [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] Registered counter for database cinder Aug 20 20:45:27.948480 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 20:45:27.949858 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writer thread running {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 20 20:45:28.344313 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.rpc [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 20 20:45:28.349116 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.rpc [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Aug 20 20:45:28.357550 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 20:45:28.370734 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.rpc [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Aug 20 20:45:28.375286 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.rpc [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Aug 20 20:45:28.379675 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.rpc [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 20 20:45:28.385059 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.rpc [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 20 20:45:28.392564 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 20:45:28.416939 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_concurrency.lockutils [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] Acquiring lock "singleton_lock" {{(pid=137470) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 20 20:45:28.417348 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_concurrency.lockutils [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] Acquired lock "singleton_lock" {{(pid=137470) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 20 20:45:28.418131 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_concurrency.lockutils [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] Releasing lock "singleton_lock" {{(pid=137470) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 20 20:45:28.418651 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] ******************************************************************************** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 20 20:45:28.418974 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] Configuration options gathered from: {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 20 20:45:28.419311 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 20 20:45:28.423086 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 20 20:45:28.423772 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] ================================================================================ {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 20 20:45:28.424495 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] allocated_capacity_weight_multiplier = -1.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.425027 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] allow_availability_zone_fallback = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.425422 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] allow_compression_on_image_upload = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.425816 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] allowed_direct_url_schemes = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.426244 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] api_rate_limit = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.426660 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] auth_strategy = keystone {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.427087 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] az_cache_duration = 3600 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.427460 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backdoor_port = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.427783 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backdoor_socket = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.428204 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_availability_zone = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.428622 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backup_api_class = cinder.backup.api.API {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.429059 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.429464 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backup_name_template = backup-%s {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.429833 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backup_use_same_host = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.430258 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backup_use_temp_snapshot = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.430642 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] capacity_weight_multiplier = 1.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.431038 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] chap_password = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.431435 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] chap_username = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.431824 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.432261 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_internal_tenant_project_id = 3b6c88840d764c2385aa678da4338213 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.433339 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_internal_tenant_user_id = 53928836828d45fbb427dd92492cae20 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.434528 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cloned_volume_same_az = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.434931 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] compression_format = gzip {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.435332 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] compute_api_class = cinder.compute.nova.API {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.435725 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] config_dir = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.436054 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.436463 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] config_source = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.436859 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.437308 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] control_exchange = openstack {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.437705 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] debug = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.438078 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] default_availability_zone = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.438516 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] default_group_type = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.439503 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.440671 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] default_volume_type = ceph {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.441053 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] driver_client_cert = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.441815 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] driver_client_cert_key = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.442191 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] driver_data_namespace = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.442769 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] driver_ssl_cert_path = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.443298 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] driver_ssl_cert_verify = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.443678 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] driver_use_ssl = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.444282 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] enable_force_upload = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.444801 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] enable_new_services = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.445179 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] enable_unsupported_driver = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.445627 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] enabled_backends = ['ceph'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.446013 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] enforce_multipath_for_image_xfer = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.446390 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] filter_function = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.446809 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_api_insecure = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.447211 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_api_servers = ['http://10.222.0.23/image'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.447585 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_api_ssl_compression = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.447955 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_ca_certificates_file = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.448343 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_catalog_info = image:glance:publicURL {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.449696 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_certfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.450146 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.450566 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_keyfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.450959 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_num_retries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.451333 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_request_timeout = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.451701 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] goodness_function = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.452093 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] graceful_shutdown_timeout = 5 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.452535 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] group_api_class = cinder.group.api.API {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.452929 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] host = ncdv-master-1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.453456 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iet_conf = /etc/iet/ietd.conf {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.454141 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_compress_on_upload = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.454529 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_conversion_address_space_limit = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.455015 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_conversion_cpu_limit = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.455491 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.455906 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_conversion_disable = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.456242 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_upload_use_cinder_backend = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.456716 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_upload_use_internal_tenant = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.457093 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_volume_cache_enabled = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.457469 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_volume_cache_max_count = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.457842 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_volume_cache_max_size_gb = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.458232 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] instance_format = [instance: %(uuid)s] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.458667 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.459061 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iscsi_iotype = fileio {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.459438 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iscsi_secondary_ip_addresses = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.459820 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iscsi_target_flags = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.460218 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iscsi_write_cache = on {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.463303 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iser_helper = tgtadm {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.464246 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iser_ip_address = 10.222.0.23 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.464867 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iser_port = 3260 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.465302 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.465652 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_config_append = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.466056 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.466440 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_dir = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.466851 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_file = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.467232 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_options = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.467603 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_rotate_interval = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.467993 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_rotate_interval_type = days {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.468406 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_rotation_type = none {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.468743 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.474385 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.475025 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.475439 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.475774 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.476167 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] max_age = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.477424 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] max_logfile_count = 30 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.477822 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] max_logfile_size_mb = 200 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.478228 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] max_over_subscription_ratio = 20.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.478613 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] message_reap_interval = 86400 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.488182 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] message_ttl = 2592000 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.488182 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] monkey_patch = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.488182 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] monkey_patch_modules = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.488579 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] my_ip = 10.222.0.23 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.488907 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] no_snapshot_gb_quota = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.489291 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] num_iser_scan_tries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.489675 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] num_shell_tries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.490052 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] num_volume_device_scan_tries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.490428 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nvmet_ns_id = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.490813 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nvmet_port_id = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.491198 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] osapi_max_limit = 1000 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.491579 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] osapi_volume_ext_list = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.491990 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.492397 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] osapi_volume_listen = 0.0.0.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.496158 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] osapi_volume_listen_port = 8776 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.496158 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] osapi_volume_use_ssl = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.496158 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] osapi_volume_workers = 2 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.496700 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] per_volume_size_limit = -1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.497468 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] periodic_fuzzy_delay = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.497859 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] periodic_interval = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.498259 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] project_id_regex = [0-9a-f\-]+ {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.498642 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] public_endpoint = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.499020 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] publish_errors = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.499400 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_backup_gigabytes = 1000 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.499789 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_backups = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.500231 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_consistencygroups = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.501710 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.502098 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_gigabytes = 1000 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.502477 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_groups = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.502871 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_snapshots = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.503260 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_volumes = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.503636 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] rate_limit_burst = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.504023 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] rate_limit_except_level = CRITICAL {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.505137 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] rate_limit_interval = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.505644 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] replication_device = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.505933 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] report_discard_supported = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.506314 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] report_interval = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.506788 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] reservation_clean_interval = 86400 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.508350 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] reservation_expire = 86400 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.508869 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] reserved_percentage = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.509264 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.509670 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.510044 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] rpc_response_timeout = 120 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.510421 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] run_external_periodic_tasks = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.512274 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_default_filters = ['AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.513601 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_default_weighers = ['CapacityWeigher'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.514070 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_driver = cinder.scheduler.filter_scheduler.FilterScheduler {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.514475 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_driver_init_wait_time = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.514864 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_host_manager = cinder.scheduler.host_manager.HostManager {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.515957 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_json_config_location = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.516442 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.516911 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_max_attempts = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.517215 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_weight_handler = cinder.scheduler.weights.OrderedHostWeightHandler {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.517607 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scst_target_driver = iscsi {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.519248 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scst_target_iqn_name = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.519641 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_down_time = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.520871 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] snapshot_name_template = snapshot-%s {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.520871 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] snapshot_same_host = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.520871 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] split_loggers = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.521120 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] state_path = /opt/stack/data/cinder {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.521475 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] storage_availability_zone = nova {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.521877 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] storage_protocol = iSCSI {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.522248 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] syslog_log_facility = LOG_USER {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.522637 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] target_helper = lioadm {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.523120 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] target_ip_address = 10.222.0.23 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.523507 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] target_port = 3260 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.524554 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.524972 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] target_protocol = iscsi {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.525345 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] trace_flags = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.525731 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] transfer_api_class = cinder.transfer.api.API {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.527011 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] transport_url = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.527416 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] until_refresh = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.528137 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_chap_auth = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.528698 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_default_quota_class = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.529189 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_eventlog = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.529573 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_journal = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.529989 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_json = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.530334 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_multipath_for_image_xfer = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.530715 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_stderr = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.531091 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_syslog = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.531483 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] verify_glance_signatures = enabled {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.531868 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_api_class = cinder.volume.api.API {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.532237 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_backend_name = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.534969 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_clear = zero {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.534969 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_clear_ionice = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.535297 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_clear_size = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.535699 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.536082 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_copy_bps_limit = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.536546 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_dd_blocksize = 1M {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.537001 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.537402 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_name_template = volume-%s {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.537788 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_number_multiplier = -1.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.538505 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_usage_audit_period = month {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.539735 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.539735 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] watch_log_file = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.539904 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.540256 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.540687 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_concurrency.disable_process_locking = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.541087 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.542317 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.542317 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.542317 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.542767 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.543271 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.543681 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.admin_password = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.544076 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.admin_tenant_name = admin {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.544492 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.admin_token = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.544873 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.admin_user = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.545263 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_admin_prefix = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.546311 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.546311 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_port = 35357 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.546488 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_protocol = https {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.546786 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_section = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.547245 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_type = password {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.547618 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_uri = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.547992 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_version = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.548816 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.cache = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.549172 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.549659 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.certfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.550045 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.delay_auth_decision = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.550497 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.550882 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.http_connect_timeout = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.551265 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.551640 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.identity_uri = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.552020 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.include_service_catalog = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.553238 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.insecure = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.553657 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.interface = public {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.554038 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.keyfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.555243 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.555243 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.555243 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.555584 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.555897 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.556270 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.556731 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.557172 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.557589 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.557967 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.region_name = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.558849 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.559321 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.service_token_roles_required = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.559811 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.service_type = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.560201 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.token_cache_time = 300 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.560620 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.www_authenticate_uri = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.561043 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.backend = dogpile.cache.null {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.561427 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.backend_argument = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.561915 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.config_prefix = cache.oslo {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.562211 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.dead_timeout = 60.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.562589 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.debug_cache_backend = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.563977 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.enable_retry_client = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.564467 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.enable_socket_keepalive = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.564858 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.enabled = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.565233 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.expiration_time = 600 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.565623 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.hashclient_retry_attempts = 2 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.566015 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.hashclient_retry_delay = 1.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.566714 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.memcache_dead_retry = 300 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.567099 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.567478 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.567859 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.memcache_pool_maxsize = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.568239 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.568826 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.memcache_servers = ['localhost:11211'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.569218 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.memcache_socket_timeout = 1.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.571952 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.proxies = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.572590 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.retry_attempts = 2 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.573184 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.retry_delay = 0.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.573581 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.socket_keepalive_count = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.574036 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.socket_keepalive_idle = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.574425 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.socket_keepalive_interval = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.574808 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.tls_allowed_ciphers = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.575182 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.tls_cafile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.575557 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.tls_certfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.575940 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.tls_enabled = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.576312 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.tls_keyfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.593145 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] coordination.backend_url = etcd3+http://10.222.0.23:2379 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.593577 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.backend = sqlalchemy {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.593988 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.connection = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.594387 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.connection_debug = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.594785 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.connection_parameters = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.595171 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.connection_recycle_time = 3600 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.595557 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.connection_trace = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.595939 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.db_inc_retry_interval = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.596317 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.db_max_retries = 20 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.596719 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.db_max_retry_interval = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.597095 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.db_retry_interval = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.597476 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.max_overflow = 50 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.597849 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.max_pool_size = 5 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.598233 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.max_retries = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.598606 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.mysql_enable_ndb = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.598992 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.mysql_sql_mode = TRADITIONAL {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.599364 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.pool_timeout = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.599745 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.retry_interval = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.600113 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.slave_connection = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.600515 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.sqlite_synchronous = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.600890 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.use_db_reconnect = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.601274 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.enforce_new_defaults = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.601646 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.enforce_scope = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.602037 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.policy_default_rule = default {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.602451 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.613434 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.policy_file = policy.yaml {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.614116 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.614694 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.614995 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.615436 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.615679 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.617612 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.connection_string = messaging:// {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.618029 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.enabled = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.618565 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.es_doc_type = notification {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.619226 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.es_scroll_size = 10000 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.619898 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.es_scroll_time = 2m {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.622530 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.filter_error_trace = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.623498 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.hmac_keys = SECRET_KEY {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.623909 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.sentinel_service_name = mymaster {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.624328 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.socket_timeout = 0.1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.624749 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.trace_sqlalchemy = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.625143 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] os_brick.lock_path = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.625537 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] privsep_osbrick.capabilities = [21] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.625922 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] privsep_osbrick.group = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.626298 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] privsep_osbrick.helper_command = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.626703 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.627102 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.627565 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] privsep_osbrick.user = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.628054 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.639130 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_sys_admin.group = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.639657 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_sys_admin.helper_command = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.640072 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.640527 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.640920 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_sys_admin.user = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.641315 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.auth_section = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.641699 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.auth_type = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.642077 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.cafile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.642453 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.certfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.642837 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.collect_timing = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.643442 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.insecure = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.643803 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.keyfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.644343 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.send_service_user_token = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.644950 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.split_loggers = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.645483 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.timeout = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.646032 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.backend_availability_zone = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.646579 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.chap_password = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.647130 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.chap_username = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.647673 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.648195 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.driver_client_cert = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.648753 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.driver_client_cert_key = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.649309 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.driver_data_namespace = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.649841 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.650368 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.650888 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.driver_use_ssl = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.651416 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.enable_unsupported_driver = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.652083 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.652719 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.filter_function = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.653442 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.goodness_function = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.653989 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.654523 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.655051 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.655580 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.656118 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.656676 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.657386 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iscsi_iotype = fileio {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.657930 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.658482 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iscsi_target_flags = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.659037 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iscsi_write_cache = on {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.659578 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iser_helper = tgtadm {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.660252 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iser_ip_address = 10.222.0.23 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.660802 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iser_port = 3260 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.661349 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.661903 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.662436 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.662965 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.num_shell_tries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.663678 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.664207 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.nvmet_ns_id = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.664768 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.nvmet_port_id = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.665306 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.replication_device = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.665843 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.report_discard_supported = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.666370 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.reserved_percentage = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.666903 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.scst_target_driver = iscsi {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.667436 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.scst_target_iqn_name = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.667989 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.storage_protocol = iSCSI {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.668619 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.target_helper = tgtadm {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.670509 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.target_ip_address = 10.222.0.23 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.671304 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.target_port = 3260 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.672116 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.673281 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.target_protocol = iscsi {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.674285 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.trace_flags = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.674972 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.unique_fqdn_network = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.675570 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.use_chap_auth = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.676183 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.676755 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volume_backend_name = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.677314 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volume_clear = zero {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.677915 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volume_clear_ionice = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.678447 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volume_clear_size = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.678996 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.679527 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.680073 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.680791 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.681330 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_reports.file_event_handler = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.681851 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.682372 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_reports.log_dir = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.682924 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.683552 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.684219 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.684775 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.685316 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.685844 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.686380 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.686898 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.687435 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.687959 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.688538 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.689075 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.689610 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.690144 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.690672 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.691527 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.692060 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.692613 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.693150 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.693667 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.694329 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.694859 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.695395 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.695919 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.696473 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.697005 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.ssl = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.697539 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.698082 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.698612 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.699256 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.699788 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.ssl_version = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.700324 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_notifications.driver = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.700879 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_notifications.retry = -1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.701444 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.701962 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_notifications.transport_url = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.702480 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.auth_section = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.703026 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.auth_type = password {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.703571 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.704340 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.certfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.704902 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.collect_timing = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.705426 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.insecure = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.705963 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.interface = public {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.706771 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.keyfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.707385 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.region_name = RegionOne {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.708002 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.split_loggers = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.708633 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.timeout = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.709151 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.token_auth_url = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.709628 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] ******************************************************************************** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 20 20:45:28.710196 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] Full set of CONF: {{(pid=137470) _wait_for_exit_or_signal /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:362}} Aug 20 20:45:28.710702 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] ******************************************************************************** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 20 20:45:28.711199 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] Configuration options gathered from: {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 20 20:45:28.711670 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 20 20:45:28.712211 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 20 20:45:28.712691 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] ================================================================================ {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 20 20:45:28.713224 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] allocated_capacity_weight_multiplier = -1.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.713678 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] allow_availability_zone_fallback = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.715700 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] allow_compression_on_image_upload = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.716179 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] allowed_direct_url_schemes = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.716666 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] api_rate_limit = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.717234 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] auth_strategy = keystone {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.717683 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] az_cache_duration = 3600 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.718129 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backdoor_port = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.718572 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backdoor_socket = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.719013 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_availability_zone = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.719441 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backup_api_class = cinder.backup.api.API {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.719894 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.720329 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backup_name_template = backup-%s {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.720793 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backup_use_same_host = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.721221 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backup_use_temp_snapshot = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.721648 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] capacity_weight_multiplier = 1.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.722100 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] chap_password = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.722535 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] chap_username = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.722971 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.723410 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_internal_tenant_project_id = 3b6c88840d764c2385aa678da4338213 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.723845 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_internal_tenant_user_id = 53928836828d45fbb427dd92492cae20 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.724493 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cloned_volume_same_az = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.724939 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] compression_format = gzip {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.725376 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] compute_api_class = cinder.compute.nova.API {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.726002 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] config_dir = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.726445 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.726908 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] config_source = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.727335 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.727773 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] control_exchange = openstack {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.728212 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] debug = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.728796 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] default_availability_zone = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.729242 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] default_group_type = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.729706 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.730325 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] default_volume_type = ceph {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.730767 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] driver_client_cert = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.731188 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] driver_client_cert_key = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.731621 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] driver_data_namespace = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.732044 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] driver_ssl_cert_path = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.732505 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] driver_ssl_cert_verify = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.732931 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] driver_use_ssl = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.733349 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] enable_force_upload = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.733765 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] enable_new_services = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.734206 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] enable_unsupported_driver = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.734815 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] enabled_backends = ['ceph'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.735258 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] enforce_multipath_for_image_xfer = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.735693 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] filter_function = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.736122 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_api_insecure = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.736577 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_api_servers = ['http://10.222.0.23/image'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.737018 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_api_ssl_compression = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.737458 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_ca_certificates_file = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.737890 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_catalog_info = image:glance:publicURL {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.738365 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_certfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.738812 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.739250 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_keyfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.739684 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_num_retries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.740119 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] glance_request_timeout = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.740592 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] goodness_function = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.742082 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] graceful_shutdown_timeout = 5 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.742802 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] group_api_class = cinder.group.api.API {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.743448 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] host = ncdv-master-1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.744092 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iet_conf = /etc/iet/ietd.conf {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.744969 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_compress_on_upload = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.745664 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_conversion_address_space_limit = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.746304 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_conversion_cpu_limit = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.747006 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.747561 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_conversion_disable = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.748053 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_upload_use_cinder_backend = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.748512 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_upload_use_internal_tenant = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.748985 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_volume_cache_enabled = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.749429 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_volume_cache_max_count = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.749858 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] image_volume_cache_max_size_gb = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.750936 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] instance_format = [instance: %(uuid)s] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.751377 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.751809 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iscsi_iotype = fileio {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.752260 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iscsi_secondary_ip_addresses = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.752776 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iscsi_target_flags = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.753223 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iscsi_write_cache = on {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.753650 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iser_helper = tgtadm {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.754076 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iser_ip_address = 10.222.0.23 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.754512 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iser_port = 3260 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.755189 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.755616 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_config_append = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.756062 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.756564 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_dir = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.756992 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_file = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.757441 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_options = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.757867 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_rotate_interval = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.758298 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_rotate_interval_type = days {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.758733 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] log_rotation_type = none {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.759158 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.759606 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.760031 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.760489 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.760925 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.761517 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] max_age = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.761969 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] max_logfile_count = 30 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.762399 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] max_logfile_size_mb = 200 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.762837 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] max_over_subscription_ratio = 20.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.763271 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] message_reap_interval = 86400 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.763695 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] message_ttl = 2592000 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.764130 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] monkey_patch = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.764612 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] monkey_patch_modules = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.765225 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] my_ip = 10.222.0.23 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.765666 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] no_snapshot_gb_quota = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.766083 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] num_iser_scan_tries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.772274 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] num_shell_tries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.773123 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] num_volume_device_scan_tries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.773766 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nvmet_ns_id = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.774416 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nvmet_port_id = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.775297 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] osapi_max_limit = 1000 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.775938 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] osapi_volume_ext_list = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.776536 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.777099 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] osapi_volume_listen = 0.0.0.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.777546 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] osapi_volume_listen_port = 8776 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.778032 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] osapi_volume_use_ssl = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.778484 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] osapi_volume_workers = 2 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.778927 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] per_volume_size_limit = -1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.779399 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] periodic_fuzzy_delay = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.779833 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] periodic_interval = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.780266 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] project_id_regex = [0-9a-f\-]+ {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.780721 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] public_endpoint = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.781151 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] publish_errors = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.781597 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_backup_gigabytes = 1000 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.782073 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_backups = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.782500 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_consistencygroups = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.782926 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.783369 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_gigabytes = 1000 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.783807 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_groups = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.784234 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_snapshots = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.784735 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] quota_volumes = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.785163 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] rate_limit_burst = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.785717 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] rate_limit_except_level = CRITICAL {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.786170 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] rate_limit_interval = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.786606 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] replication_device = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.787126 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] report_discard_supported = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.787566 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] report_interval = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.788004 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] reservation_clean_interval = 86400 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.788465 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] reservation_expire = 86400 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.788906 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] reserved_percentage = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.789332 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.789756 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.790195 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] rpc_response_timeout = 120 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.790621 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] run_external_periodic_tasks = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.791060 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_default_filters = ['AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.791490 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_default_weighers = ['CapacityWeigher'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.791912 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_driver = cinder.scheduler.filter_scheduler.FilterScheduler {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.792338 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_driver_init_wait_time = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.793422 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_host_manager = cinder.scheduler.host_manager.HostManager {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.793938 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_json_config_location = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.794370 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.794801 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_max_attempts = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.795234 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scheduler_weight_handler = cinder.scheduler.weights.OrderedHostWeightHandler {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.795811 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scst_target_driver = iscsi {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.796253 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] scst_target_iqn_name = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.796711 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_down_time = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.797150 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] snapshot_name_template = snapshot-%s {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.797583 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] snapshot_same_host = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.798010 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] split_loggers = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.798442 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] state_path = /opt/stack/data/cinder {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.798879 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] storage_availability_zone = nova {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.799304 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] storage_protocol = iSCSI {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.799737 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] syslog_log_facility = LOG_USER {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.800168 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] target_helper = lioadm {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.800631 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] target_ip_address = 10.222.0.23 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.801071 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] target_port = 3260 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.801504 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.801942 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] target_protocol = iscsi {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.802377 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] trace_flags = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.802802 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] transfer_api_class = cinder.transfer.api.API {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.803241 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] transport_url = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.803671 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] until_refresh = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.804103 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_chap_auth = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.804633 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_default_quota_class = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.805070 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_eventlog = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.805723 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_journal = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.806160 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_json = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.806584 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_multipath_for_image_xfer = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.807016 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_stderr = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.807450 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] use_syslog = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.807880 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] verify_glance_signatures = enabled {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.808461 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_api_class = cinder.volume.api.API {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.808905 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_backend_name = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.809344 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_clear = zero {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.809776 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_clear_ionice = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.810207 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_clear_size = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.810639 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.811157 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_copy_bps_limit = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.811592 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_dd_blocksize = 1M {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.812026 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.812480 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_name_template = volume-%s {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.812907 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_number_multiplier = -1.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.813345 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volume_usage_audit_period = month {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.813769 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.814789 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] watch_log_file = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 20 20:45:28.815247 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.815895 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.816932 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_concurrency.disable_process_locking = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.817391 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.817836 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.818283 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.818758 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_metrics.metrics_process_name = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.819188 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.819620 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.820084 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.admin_password = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.820550 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.admin_tenant_name = admin {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.820984 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.admin_token = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.821411 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.admin_user = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.821834 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_admin_prefix = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.822246 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.822658 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_port = 35357 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.823070 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_protocol = https {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.823502 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_section = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.824250 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_type = password {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.824713 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_uri = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.825188 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.auth_version = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.825622 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.cache = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.826221 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.826638 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.certfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.827061 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.delay_auth_decision = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.827483 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.827898 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.http_connect_timeout = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.828327 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.828763 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.identity_uri = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.829189 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.include_service_catalog = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.829603 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.insecure = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.830036 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.interface = public {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.831393 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.keyfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.831836 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.832262 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.832737 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.833157 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.833596 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.834021 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.834446 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.834862 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.835291 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.835705 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.region_name = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.836304 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.836874 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.service_token_roles_required = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.837306 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.service_type = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.837734 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.token_cache_time = 300 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.838174 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] keystone_authtoken.www_authenticate_uri = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.838847 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.backend = dogpile.cache.null {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.839317 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.backend_argument = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.839914 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.config_prefix = cache.oslo {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.840419 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.dead_timeout = 60.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.840846 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.debug_cache_backend = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.841305 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.enable_retry_client = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.841728 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.enable_socket_keepalive = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.842171 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.enabled = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.842614 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.expiration_time = 600 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.843048 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.hashclient_retry_attempts = 2 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.843601 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.hashclient_retry_delay = 1.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.844048 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.memcache_dead_retry = 300 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.844517 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.844974 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.845413 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.memcache_pool_maxsize = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.845831 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.846442 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.memcache_servers = ['localhost:11211'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.846866 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.memcache_socket_timeout = 1.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.847293 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.proxies = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.847720 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.retry_attempts = 2 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.848137 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.retry_delay = 0.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.848611 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.socket_keepalive_count = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.849054 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.socket_keepalive_idle = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.849471 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.socket_keepalive_interval = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.849896 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.tls_allowed_ciphers = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.850309 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.tls_cafile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.850741 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.tls_certfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.851229 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.tls_enabled = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.851654 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cache.tls_keyfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.852075 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] coordination.backend_url = etcd3+http://10.222.0.23:2379 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.852546 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.backend = sqlalchemy {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.852979 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.connection = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.853415 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.connection_debug = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.853845 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.connection_parameters = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.854283 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.connection_recycle_time = 3600 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.854787 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.connection_trace = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.855916 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.db_inc_retry_interval = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.856937 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.db_max_retries = 20 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.857850 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.db_max_retry_interval = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.858484 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.db_retry_interval = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.859122 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.max_overflow = 50 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.859749 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.max_pool_size = 5 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.860337 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.max_retries = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.861013 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.mysql_enable_ndb = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.861384 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.mysql_sql_mode = TRADITIONAL {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.861683 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.pool_timeout = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.862019 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.retry_interval = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.862326 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.slave_connection = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.862755 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.sqlite_synchronous = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.863056 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] database.use_db_reconnect = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.863462 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.enforce_new_defaults = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.863756 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.enforce_scope = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.864049 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.policy_default_rule = default {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.864345 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.864660 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.policy_file = policy.yaml {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.865084 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.867500 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.868016 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.877094 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.877908 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.878381 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.connection_string = messaging:// {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.878833 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.enabled = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.879288 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.es_doc_type = notification {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.884404 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.es_scroll_size = 10000 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.884988 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.es_scroll_time = 2m {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.885444 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.filter_error_trace = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.885893 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.hmac_keys = SECRET_KEY {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.886370 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.sentinel_service_name = mymaster {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.896410 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.socket_timeout = 0.1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.897255 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] profiler.trace_sqlalchemy = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.897739 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] os_brick.lock_path = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.898789 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] privsep_osbrick.capabilities = [21] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.899242 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] privsep_osbrick.group = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.899695 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] privsep_osbrick.helper_command = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.900136 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.900650 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.901133 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] privsep_osbrick.user = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.901586 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.902076 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_sys_admin.group = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.909450 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_sys_admin.helper_command = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.910232 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.910737 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.911189 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] cinder_sys_admin.user = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.911653 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.auth_section = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.912107 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.auth_type = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.912568 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.cafile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.913206 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.certfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.913753 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.collect_timing = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.922581 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.insecure = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.924246 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.keyfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.924727 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.send_service_user_token = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.925214 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.split_loggers = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.925661 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] service_user.timeout = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.926129 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.backend_availability_zone = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.926579 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.chap_password = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.927017 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.chap_username = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.927467 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.927904 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.driver_client_cert = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.928340 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.driver_client_cert_key = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.928793 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.driver_data_namespace = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.929240 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.941747 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.942248 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.driver_use_ssl = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.942711 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.enable_unsupported_driver = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.943167 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.943611 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.filter_function = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.944062 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.goodness_function = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.944541 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.944993 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.945430 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.945867 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.946316 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.946766 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.947202 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iscsi_iotype = fileio {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.947644 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.948076 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iscsi_target_flags = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.948549 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iscsi_write_cache = on {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.949006 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iser_helper = tgtadm {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.949452 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iser_ip_address = 10.222.0.23 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.949870 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iser_port = 3260 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.950286 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.950715 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.951973 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.952455 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.num_shell_tries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.952896 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.953315 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.nvmet_ns_id = 10 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.953735 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.nvmet_port_id = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.954160 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.replication_device = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.954588 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.report_discard_supported = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.955012 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.reserved_percentage = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.955438 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.scst_target_driver = iscsi {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.955861 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.scst_target_iqn_name = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.956287 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.storage_protocol = iSCSI {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.956753 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.target_helper = tgtadm {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.957167 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.target_ip_address = 10.222.0.23 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.957582 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.target_port = 3260 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.957994 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.958417 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.target_protocol = iscsi {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.958840 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.trace_flags = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.959264 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.unique_fqdn_network = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.959685 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.use_chap_auth = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.960129 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.960589 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volume_backend_name = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.961042 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volume_clear = zero {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.961480 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volume_clear_ionice = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.962143 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volume_clear_size = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.962570 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.963005 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.963430 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.963872 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.964637 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_reports.file_event_handler = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.965203 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.965828 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_reports.log_dir = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.966501 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.967118 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.968109 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.968755 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.969377 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.970006 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.970623 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.971137 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.971607 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.972319 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.972796 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.973220 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.973696 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.974110 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.974524 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.974938 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.975348 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.975816 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.976337 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.976773 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.978493 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.978971 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.979428 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.979891 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.980462 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.981133 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.ssl = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.981747 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.982422 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.982867 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.983289 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.983718 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_rabbit.ssl_version = {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.984150 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_notifications.driver = [] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.984609 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_notifications.retry = -1 {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.985049 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.985494 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] oslo_messaging_notifications.transport_url = **** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.985935 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.auth_section = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.986378 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.auth_type = password {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.986818 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.987258 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.certfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.987705 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.collect_timing = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.988144 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.insecure = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.988663 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.interface = public {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.989106 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.keyfile = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.989531 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.region_name = RegionOne {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.989970 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.split_loggers = False {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.990383 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.timeout = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.990808 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] nova.token_auth_url = None {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 20 20:45:28.991222 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.service [None req-5d58a36f-56c5-4c2b-9749-0237e54784bf None None] ******************************************************************************** {{(pid=137470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 20 20:45:28.991820 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.service [-] Starting cinder-scheduler node (version 20.1.0) Aug 20 20:45:28.993085 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.manager [None req-0920a376-6b3c-4029-9f2b-c01b2d50baa1 None None] Initiating service 1 cleanup Aug 20 20:45:29.006795 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.manager [None req-0920a376-6b3c-4029-9f2b-c01b2d50baa1 None None] Service 1 cleanup completed. Aug 20 20:45:29.007368 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-0920a376-6b3c-4029-9f2b-c01b2d50baa1 None None] Creating RPC server for service cinder-scheduler {{(pid=137470) start /opt/stack/cinder/cinder/service.py:238}} Aug 20 20:45:29.032918 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.service [None req-0920a376-6b3c-4029-9f2b-c01b2d50baa1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=137470) start /opt/stack/cinder/cinder/service.py:244}} Aug 20 20:45:30.856068 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-8af456ec-bd11-4d9f-b801-265533aba64b None None] Received backup service update from ncdv-master-1: {'backend_state': False, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 20:45:32.870449 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-a73f9473-f3d8-485e-9651-2aef42c1568d None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:45:32.892361 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-a73f9473-f3d8-485e-9651-2aef42c1568d None None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 8, 20, 20, 45, 32, 840804)} {{(pid=137470) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Aug 20 20:45:42.885014 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=24,cinder:INSERT=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:46:13.154090 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:46:30.155744 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.periodic_task [None req-fcbcdb1d-e300-460d-80eb-dcb164337a0b None None] Running periodic task SchedulerManager._clean_expired_messages {{(pid=137470) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Aug 20 20:46:30.161724 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-fcbcdb1d-e300-460d-80eb-dcb164337a0b None None] Deleted 0 expired messages. Aug 20 20:46:30.162069 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_service.periodic_task [None req-fcbcdb1d-e300-460d-80eb-dcb164337a0b None None] Running periodic task SchedulerManager._clean_expired_reservation {{(pid=137470) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Aug 20 20:46:53.160018 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:46:59.131714 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-7d58c503-200e-429d-bf5d-6a7117b21cf5 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:47:26.877903 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-01225f44-aeaa-4e07-af5c-c3d09a384105 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 20:47:33.163751 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:47:59.141522 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-e7e3fe7e-e8a6-4519-b633-d9f77400e86a None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:48:13.167695 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:48:26.873965 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-c1bf081e-d22f-40d5-8de0-e5e4b9e1a373 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 20:48:43.180279 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:48:59.142387 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-70866186-43e2-4250-8eb0-95a30ca48751 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:49:23.176601 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:49:26.880700 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-e7ac6399-d517-4428-894e-069ffc6ef0be None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 20:49:59.133893 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-9819d0c9-f8c3-40ec-aebb-4d6b82f42af4 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:50:03.181094 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:50:26.878815 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-91e05edb-778d-4cc1-80f6-6501077c5353 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 20:50:33.190355 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:50:59.155154 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-d579c45f-42e5-4d7f-be03-0e30da4ed134 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:51:03.203577 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:51:26.884001 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-ccd946f8-d887-4ae7-9f09-964cc115590a None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 20:51:33.211283 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:51:59.146276 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-bd19a813-3bab-4bdd-a198-ac93e76a6442 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:52:13.215456 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:52:26.881073 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-b6287d6f-0ab3-4b62-8945-ff05ee907c5f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 20:52:43.231065 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:52:59.163337 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-9ed542b9-0677-4828-9c8d-695c00953cc4 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:53:23.223237 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:53:26.877568 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-ad7f9457-9c7a-4565-9de0-8ed42542fc7d None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 20:53:59.164969 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-b93c7321-d025-4990-8516-7680dac95198 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:54:03.221216 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:54:26.873954 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-09d370d7-fea0-465d-8642-9ffde4a25546 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 20:54:43.223873 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:54:59.259494 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-49675256-0849-4334-acb2-5e682db65cc1 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:55:13.254080 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:55:26.881181 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-9fa474f7-6043-4db6-9879-50b7f53d5aa2 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 20:55:53.250704 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:55:59.263691 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-88a46518-5aea-4fd7-abc2-17737bf6cb7c None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:56:23.267602 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:56:26.884805 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-3d53cad4-b572-4837-9b4d-d48b0e4969d8 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 20:56:59.328293 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-2d678d39-754a-4993-bc15-00477b790a75 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:57:03.266816 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:57:26.876427 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-1a5c50e2-976a-4ba2-ba89-652471d07dc9 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 20:57:43.267231 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:57:59.315942 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-0ade1a57-a25b-4889-a037-bf6b9feae66b None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:58:14.627639 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:58:14.695331 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Flow 'volume_create_scheduler' (9a6e9f9c-e049-418a-bf27-e832e0f37d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 20:58:14.700674 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (263240fe-18bf-468f-98e2-1f317f57621f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 20:58:14.706646 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (263240fe-18bf-468f-98e2-1f317f57621f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2efb129b-eff3-4d17-a3f0-4bc2f9136a93),volume_id=2efb129b-eff3-4d17-a3f0-4bc2f9136a93,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 20:58:14.728832 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ddeb0c4b-cd2e-4962-8ee6-28b632bd9b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 20:58:14.746359 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 20:58:14.807817 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 8, 20, 20, 57, 59, 307728)} {{(pid=137470) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Aug 20 20:58:14.808261 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Starting with 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 20:58:14.808692 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 20:58:14.809074 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (2efb129b-eff3-4d17-a3f0-4bc2f9136a93) {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Aug 20 20:58:14.809477 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 0, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 0, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 20:57:59.307728 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Aug 20 20:58:14.811491 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/398.8 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Aug 20 20:58:14.812109 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Filter CapacityFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 20:58:14.812718 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 20:58:14.813329 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 0, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 0, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 20:57:59.307728] {{(pid=137470) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Aug 20 20:58:14.814576 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_weight [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Weigher CapacityWeigher returned, weigher value is {max: 398.8, min: 398.8} {{(pid=137470) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Aug 20 20:58:14.815211 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=137470) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Aug 20 20:58:14.816216 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Choosing ncdv-master-1@ceph#ceph {{(pid=137470) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Aug 20 20:58:14.816977 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 20:58:14.816550 {{(pid=137470) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Aug 20 20:58:14.989378 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ddeb0c4b-cd2e-4962-8ee6-28b632bd9b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 20:58:14.994257 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-cd34914a-8d53-479d-920d-6a2e8a1ec7b2 tempest-VolumesAdminNegativeTest-27676829 None] Flow 'volume_create_scheduler' (9a6e9f9c-e049-418a-bf27-e832e0f37d0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 20:58:26.875622 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-536fba28-5676-42a8-b88f-4f7a81e91e68 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 20:58:53.283718 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:58:54.972535 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Flow 'volume_create_scheduler' (09a2dd86-6ebe-4139-99a0-95e8a989006d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 20:58:54.998968 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (916fd8b7-6ab8-40b8-9221-a1be7db7f302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 20:58:55.010234 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (916fd8b7-6ab8-40b8-9221-a1be7db7f302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(d25336c4-c00e-4b81-bf1e-a586b05bf6d2),volume_id=d25336c4-c00e-4b81-bf1e-a586b05bf6d2,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 20:58:55.033006 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (00345758-f3f3-439c-ba90-7db99c1beca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 20:58:55.054722 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 20:58:55.092731 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 8, 20, 20, 57, 59, 307728)} {{(pid=137470) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Aug 20 20:58:55.093136 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Starting with 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 20:58:55.093508 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 20:58:55.093871 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (d25336c4-c00e-4b81-bf1e-a586b05bf6d2) {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Aug 20 20:58:55.094273 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 20:58:14.816550 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Aug 20 20:58:55.094621 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/378.8 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Aug 20 20:58:55.095188 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Filter CapacityFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 20:58:55.095582 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 20:58:55.095949 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 20:58:14.816550] {{(pid=137470) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Aug 20 20:58:55.097132 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_weight [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Weigher CapacityWeigher returned, weigher value is {max: 397.8, min: 397.8} {{(pid=137470) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Aug 20 20:58:55.097640 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=137470) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Aug 20 20:58:55.098274 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Choosing ncdv-master-1@ceph#ceph {{(pid=137470) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Aug 20 20:58:55.098826 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.94, total_capacity_gb: 19.94, allocated_capacity_gb: 2, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 20:58:55.098463 {{(pid=137470) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Aug 20 20:58:55.182768 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (00345758-f3f3-439c-ba90-7db99c1beca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 20:58:55.201540 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e7b65f2e-0d10-4570-a3e7-389400b11ac0 tempest-VolumesAdminNegativeTest-27676829 None] Flow 'volume_create_scheduler' (09a2dd86-6ebe-4139-99a0-95e8a989006d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 20:58:58.637161 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-f1f1a563-ef24-4a6d-a78b-df37c91b52f5 tempest-VolumesAdminNegativeTest-27676829 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 1, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:58:59.274959 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-ed6c3dee-734f-4034-af8b-d4947af5f116 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 1, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:59:06.593734 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-450e6b84-2a66-4be2-9331-b154240ec0da tempest-VolumesAdminNegativeTest-27676829 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 20:59:26.873232 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-599408aa-3da4-466c-b6a7-5a6d88e35fbc None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 20:59:33.285595 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 20:59:52.961088 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Flow 'volume_create_scheduler' (efe80de1-bf05-4e54-852f-1a80a4eeb382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 20:59:52.975877 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e51e190f-a848-4c2a-b40b-f2edf9df04bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 20:59:52.987818 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e51e190f-a848-4c2a-b40b-f2edf9df04bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2c684cdd-8c9b-467e-ae3e-ba5141281cbc),volume_id=2c684cdd-8c9b-467e-ae3e-ba5141281cbc,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 20:59:52.993586 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (abc44278-90b7-4650-b42a-7d059c51e43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 20:59:53.003959 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 20:59:53.021071 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 8, 20, 20, 59, 6, 588311)} {{(pid=137470) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Aug 20 20:59:53.021506 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Starting with 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 20:59:53.021865 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 20:59:53.022462 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (2c684cdd-8c9b-467e-ae3e-ba5141281cbc) {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Aug 20 20:59:53.023342 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 0, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 0, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 20:59:06.588311 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Aug 20 20:59:53.023914 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/398.8 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Aug 20 20:59:53.024491 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Filter CapacityFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 20:59:53.025783 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 20:59:53.026413 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 0, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 0, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 20:59:06.588311] {{(pid=137470) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Aug 20 20:59:53.027198 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_weight [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Weigher CapacityWeigher returned, weigher value is {max: 398.8, min: 398.8} {{(pid=137470) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Aug 20 20:59:53.027834 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=137470) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Aug 20 20:59:53.028710 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Choosing ncdv-master-1@ceph#ceph {{(pid=137470) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Aug 20 20:59:53.030704 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 20:59:53.028957 {{(pid=137470) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Aug 20 20:59:53.096157 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (abc44278-90b7-4650-b42a-7d059c51e43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 20:59:53.107082 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-f77e05a7-b40a-497b-b13e-00e7a0377c56 tempest-LiveAutoBlockMigrationV225Test-165698469 None] Flow 'volume_create_scheduler' (efe80de1-bf05-4e54-852f-1a80a4eeb382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 20:59:59.171920 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-a0b61aac-4b0a-4378-aee1-0c71b71adb67 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 1, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 21:00:13.294137 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:00:26.871606 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-608a9c33-3390-4046-8e97-e0da2c658a1e None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:00:31.407700 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Flow 'volume_create_scheduler' (552d2b0a-d4a4-4683-b61d-78c855dc1fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:00:31.416287 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c3ce347a-8fb3-4e29-a20b-f594c3a75b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:00:31.423487 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c3ce347a-8fb3-4e29-a20b-f594c3a75b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=cdbd7b72-a449-4911-a314-de189b7a9b1c,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9929c09d-47b3-4e90-b04b-521510460b64),volume_id=9929c09d-47b3-4e90-b04b-521510460b64,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:00:31.430907 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cda6e751-0bd2-4d77-b3eb-de01969d0853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:00:31.443896 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:00:31.462867 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 1, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 8, 20, 20, 59, 59, 165047)} {{(pid=137470) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Aug 20 21:00:31.463370 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Starting with 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:00:31.463756 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:00:31.464634 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (9929c09d-47b3-4e90-b04b-521510460b64) {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Aug 20 21:00:31.465044 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 20:59:59.165047 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Aug 20 21:00:31.465440 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/398.8 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Aug 20 21:00:31.465787 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Filter CapacityFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:00:31.466689 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:00:31.466689 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 20:59:59.165047] {{(pid=137470) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Aug 20 21:00:31.467260 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_weight [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Weigher CapacityWeigher returned, weigher value is {max: 397.8, min: 397.8} {{(pid=137470) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Aug 20 21:00:31.467618 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=137470) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Aug 20 21:00:31.468204 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Choosing ncdv-master-1@ceph#ceph {{(pid=137470) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Aug 20 21:00:31.468614 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 2, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:00:31.468235 {{(pid=137470) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Aug 20 21:00:31.505362 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cda6e751-0bd2-4d77-b3eb-de01969d0853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:00:31.509133 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d362bca9-c924-4d02-a267-61d3cb69419a tempest-LiveAutoBlockMigrationV225Test-165698469 None] Flow 'volume_create_scheduler' (552d2b0a-d4a4-4683-b61d-78c855dc1fc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:00:33.186450 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Flow 'volume_create_scheduler' (463a0a6d-3bec-4283-b547-7fc5b54f3a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:00:33.205228 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0529385e-d1af-4419-be3f-1f24cdad81cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:00:33.222897 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0529385e-d1af-4419-be3f-1f24cdad81cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(6aab6b13-d5cd-4e27-b735-df6289512ea1),volume_id=6aab6b13-d5cd-4e27-b735-df6289512ea1,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:00:33.229971 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8a29c28c-9b35-416c-a584-833a14219fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:00:33.250417 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:00:33.289871 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 1, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 8, 20, 20, 59, 59, 165047)} {{(pid=137470) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Aug 20 21:00:33.291212 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Starting with 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:00:33.291582 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:00:33.293206 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (6aab6b13-d5cd-4e27-b735-df6289512ea1) {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Aug 20 21:00:33.293615 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 2, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:00:31.468235 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Aug 20 21:00:33.294807 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/378.8 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Aug 20 21:00:33.295157 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Filter CapacityFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:00:33.295545 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:00:33.295917 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 2, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:00:31.468235] {{(pid=137470) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Aug 20 21:00:33.296343 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_weight [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Weigher CapacityWeigher returned, weigher value is {max: 396.8, min: 396.8} {{(pid=137470) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Aug 20 21:00:33.296719 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=137470) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Aug 20 21:00:33.297191 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Choosing ncdv-master-1@ceph#ceph {{(pid=137470) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Aug 20 21:00:33.298395 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.94, total_capacity_gb: 19.94, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:00:33.298027 {{(pid=137470) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Aug 20 21:00:33.365486 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8a29c28c-9b35-416c-a584-833a14219fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:00:33.369365 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-10e74593-fe39-4914-ae0a-789ea28299a5 tempest-ServerRescueNegativeTestJSON-1405733180 None] Flow 'volume_create_scheduler' (463a0a6d-3bec-4283-b547-7fc5b54f3a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:00:33.746644 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Flow 'volume_create_scheduler' (2fdb0528-b9c0-40fc-a86f-b41eb6c7f54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:00:33.754191 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6310b99f-b522-4738-90d2-093a8dfb4cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:00:33.760944 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6310b99f-b522-4738-90d2-093a8dfb4cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f32f5a51-d557-424a-a95d-eda4904c4efd),volume_id=f32f5a51-d557-424a-a95d-eda4904c4efd,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:00:33.779312 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5ad1aa1b-8fa5-49f4-961f-100a0ac5e642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:00:33.789827 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:00:33.808960 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 1, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 8, 20, 20, 59, 59, 165047)} {{(pid=137470) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Aug 20 21:00:33.809707 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Starting with 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:00:33.810272 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:00:33.811230 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (f32f5a51-d557-424a-a95d-eda4904c4efd) {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Aug 20 21:00:33.811823 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.94, total_capacity_gb: 19.94, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:00:33.298027 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Aug 20 21:00:33.812392 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/358.8 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Aug 20 21:00:33.812919 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Filter CapacityFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:00:33.813504 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:00:33.814067 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.94, total_capacity_gb: 19.94, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:00:33.298027] {{(pid=137470) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Aug 20 21:00:33.814696 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_weight [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Weigher CapacityWeigher returned, weigher value is {max: 395.8, min: 395.8} {{(pid=137470) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Aug 20 21:00:33.815822 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=137470) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Aug 20 21:00:33.816700 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Choosing ncdv-master-1@ceph#ceph {{(pid=137470) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Aug 20 21:00:33.817525 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 16.94, total_capacity_gb: 19.94, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:00:33.816908 {{(pid=137470) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Aug 20 21:00:33.856686 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5ad1aa1b-8fa5-49f4-961f-100a0ac5e642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:00:33.860653 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-04ded323-d60e-4c8d-b96e-052ed5caf44b tempest-AttachSCSIVolumeTestJSON-1843201815 None] Flow 'volume_create_scheduler' (2fdb0528-b9c0-40fc-a86f-b41eb6c7f54f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:00:38.192923 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Flow 'volume_create_scheduler' (0f0ef278-517c-4e9f-968e-0507524eaed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:00:38.216066 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f4faa4a5-b554-4d6a-8043-68dd84dcc18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:00:38.245700 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f4faa4a5-b554-4d6a-8043-68dd84dcc18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(997d5f5d-e99e-462a-8484-14b1195f85a5),volume_id=997d5f5d-e99e-462a-8484-14b1195f85a5,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:00:38.252902 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2f4bff59-e8bf-40bf-be4c-b9d0ae70d660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:00:38.271090 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:00:38.307194 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 1, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 8, 20, 20, 59, 59, 165047)} {{(pid=137470) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Aug 20 21:00:38.310266 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Starting with 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:00:38.310889 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:00:38.311469 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (997d5f5d-e99e-462a-8484-14b1195f85a5) {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Aug 20 21:00:38.313135 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 16.94, total_capacity_gb: 19.94, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:00:33.816908 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Aug 20 21:00:38.321071 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/338.8 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Aug 20 21:00:38.321693 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Filter CapacityFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:00:38.322305 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:00:38.322891 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 16.94, total_capacity_gb: 19.94, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:00:33.816908] {{(pid=137470) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Aug 20 21:00:38.323624 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_weight [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Weigher CapacityWeigher returned, weigher value is {max: 394.8, min: 394.8} {{(pid=137470) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Aug 20 21:00:38.328952 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=137470) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Aug 20 21:00:38.329815 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Choosing ncdv-master-1@ceph#ceph {{(pid=137470) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Aug 20 21:00:38.330493 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 15.940000000000001, total_capacity_gb: 19.94, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:00:38.330045 {{(pid=137470) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Aug 20 21:00:38.399312 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2f4bff59-e8bf-40bf-be4c-b9d0ae70d660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:00:38.402472 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-99484229-abdb-4095-9c3a-5ab022ac2739 tempest-LiveMigrationTest-1089825478 None] Flow 'volume_create_scheduler' (0f0ef278-517c-4e9f-968e-0507524eaed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:00:43.336842 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=53,cinder:UPDATE=11 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:00:59.302670 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-053ccce8-85a5-4b30-b2af-0b7c0ddf59d9 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 5, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 21:01:08.326118 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-8cd1f3db-79a0-4532-9e19-b1a8fe380294 tempest-AttachSCSIVolumeTestJSON-1843201815 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.98, 'free_capacity_gb': 19.88, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 4, 'filter_function': None, 'goodness_function': None} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Aug 20 21:01:08.752068 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Flow 'volume_create_scheduler' (1e7ac6a9-648b-468e-b709-f8815c8c4a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:01:08.757997 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4813ea4c-014a-4f5b-876e-1c67357baf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:01:08.764558 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4813ea4c-014a-4f5b-876e-1c67357baf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b4e47d00-e3cb-47d4-a932-c6b81c03aac3),volume_id=b4e47d00-e3cb-47d4-a932-c6b81c03aac3,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:01:08.769116 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (79811e44-e1c5-47aa-81aa-943919185c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:01:08.788729 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:01:08.816235 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.98, 'free_capacity_gb': 19.88, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 4, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 8, 20, 21, 1, 8, 317932)} {{(pid=137470) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Aug 20 21:01:08.816981 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Starting with 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:01:08.817572 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:01:08.818115 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (b4e47d00-e3cb-47d4-a932-c6b81c03aac3) {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Aug 20 21:01:08.818833 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.88, total_capacity_gb: 19.98, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:01:08.317932 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Aug 20 21:01:08.819450 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/397.59999999999997 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Aug 20 21:01:08.832981 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Filter CapacityFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:01:08.833630 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:01:08.836980 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.88, total_capacity_gb: 19.98, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:01:08.317932] {{(pid=137470) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Aug 20 21:01:08.837659 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_weight [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Weigher CapacityWeigher returned, weigher value is {max: 395.6, min: 395.6} {{(pid=137470) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Aug 20 21:01:08.838537 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=137470) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Aug 20 21:01:08.839791 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Choosing ncdv-master-1@ceph#ceph {{(pid=137470) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Aug 20 21:01:08.840453 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.88, total_capacity_gb: 19.98, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:01:08.839995 {{(pid=137470) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Aug 20 21:01:08.895587 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (79811e44-e1c5-47aa-81aa-943919185c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:01:08.905547 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c5dae2f1-c847-4266-8063-a5be2a701c97 tempest-ServerRescueNegativeTestJSON-1405733180 None] Flow 'volume_create_scheduler' (1e7ac6a9-648b-468e-b709-f8815c8c4a01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:01:23.334093 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:01:25.199852 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Flow 'volume_create_scheduler' (eac8b721-76ed-4ad0-8125-a580d9a5f17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:01:25.204818 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (cdc8d993-80ec-4ae7-a933-ab4f455acf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:01:25.210937 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (cdc8d993-80ec-4ae7-a933-ab4f455acf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=cdbd7b72-a449-4911-a314-de189b7a9b1c,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(225305f0-0be2-458a-b442-6a1a7d90e391),volume_id=225305f0-0be2-458a-b442-6a1a7d90e391,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:01:25.216984 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ffcaa246-1895-4f26-9cc3-9fcabd61d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:01:25.232672 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:01:25.261884 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.98, 'free_capacity_gb': 19.88, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:c29ed167-ad78-4f1a-85fa-70ae1d13328f:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 4, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 8, 20, 21, 1, 8, 317932)} {{(pid=137470) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Aug 20 21:01:25.262661 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Starting with 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:01:25.263215 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:01:25.263942 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (225305f0-0be2-458a-b442-6a1a7d90e391) {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Aug 20 21:01:25.265177 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.88, total_capacity_gb: 19.98, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:01:08.839995 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Aug 20 21:01:25.265542 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filters.capacity_filter [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/377.59999999999997 {{(pid=137470) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Aug 20 21:01:25.265949 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Filter CapacityFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:01:25.266340 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:01:25.266712 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.88, total_capacity_gb: 19.98, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:01:08.839995] {{(pid=137470) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Aug 20 21:01:25.267134 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_weight [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Weigher CapacityWeigher returned, weigher value is {max: 394.6, min: 394.6} {{(pid=137470) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Aug 20 21:01:25.267484 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=137470) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Aug 20 21:01:25.267965 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.filter_scheduler [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Choosing ncdv-master-1@ceph#ceph {{(pid=137470) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Aug 20 21:01:25.268345 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.88, total_capacity_gb: 19.98, allocated_capacity_gb: 6, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 6, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-08-20 21:01:25.267994 {{(pid=137470) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Aug 20 21:01:25.303427 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ffcaa246-1895-4f26-9cc3-9fcabd61d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:01:25.306834 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-fd4711dc-4749-4d24-bfe1-d277ac0edc08 tempest-LiveMigrationTest-1089825478 None] Flow 'volume_create_scheduler' (eac8b721-76ed-4ad0-8125-a580d9a5f17f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:01:26.870714 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-e2a7aefb-5d6f-46e8-be0b-0da46b7969ef None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:02:03.343505 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:02:26.870483 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-f2bc4667-1a4d-4b3b-919c-1ce0edc5d166 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:02:43.341389 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:03:23.358216 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:03:26.873417 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-3ae3b869-d6bc-41d2-91e0-f6fddf77b4f4 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:04:03.368591 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:04:26.882223 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-97f70d41-6605-4b66-abce-7179e732368e None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:04:43.370275 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:05:10.384915 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Flow 'volume_create_scheduler' (6643a262-a144-4f0e-853f-e771effa59ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:05:10.390160 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fd073819-1144-4a49-bf5c-f0a87eb2d88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:05:10.394901 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fd073819-1144-4a49-bf5c-f0a87eb2d88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(11d37575-782b-41ef-b129-7c1cfc0cf2c5),volume_id=11d37575-782b-41ef-b129-7c1cfc0cf2c5,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:05:10.399380 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6c9d82fa-9a47-44cd-9935-a805685aa581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:05:10.408730 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:05:10.426533 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:05:10.427413 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.host_manager [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Removing non-active backend: ncdv-master-1@ceph from scheduler cache. Aug 20 21:05:10.427413 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:05:10.427573 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:05:10.427920 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:05:10.428305 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:05:10.428776 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Filtering removed all hosts for the request with volume ID '11d37575-782b-41ef-b129-7c1cfc0cf2c5'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:05:10.429328 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Filtering removed all hosts for the request with volume ID '11d37575-782b-41ef-b129-7c1cfc0cf2c5'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:05:10.430949 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:05:10.431659 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Creating message record for request_id = req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 Aug 20 21:05:10.444065 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:05:10.445710 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Setting Volume 11d37575-782b-41ef-b129-7c1cfc0cf2c5 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:05:10.463801 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6c9d82fa-9a47-44cd-9935-a805685aa581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:05:10.472905 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2f750a8c-e05e-46c1-ac47-83c6fbf5c5b8 tempest-DeleteServersTestJSON-715074304 None] Flow 'volume_create_scheduler' (6643a262-a144-4f0e-853f-e771effa59ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:05:23.371871 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:05:26.878443 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-303b70da-44cf-4395-87bb-c7d0efe47c7b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:06:03.370215 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:06:26.888014 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-bf8783fa-5a97-4843-a8bb-be96d1903283 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:06:43.378600 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:07:23.369559 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:07:26.387809 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-d153a48e-1437-451a-8b77-d739ab65cbfc tempest-GroupSnapshotsV319Test-1572622034 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:07:26.393856 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-d153a48e-1437-451a-8b77-d739ab65cbfc tempest-GroupSnapshotsV319Test-1572622034 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:07:26.394398 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.manager [None req-d153a48e-1437-451a-8b77-d739ab65cbfc tempest-GroupSnapshotsV319Test-1572622034 None] Could not find a backend for group 75307ffb-b9d0-4f83-9b49-2872d150a280.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:07:26.881503 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-fe4c6112-6d76-42d1-857f-16d927149f69 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:07:31.845382 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-498421ae-a00d-41f8-bbba-e9fdd76b34a2 tempest-VolumePoolsAdminTestsJSON-450348575 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:07:31.964454 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-ea375280-808b-4dc3-a58f-f3160dc4b8a9 tempest-VolumePoolsAdminTestsJSON-450348575 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:07:37.120334 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] Flow 'volume_create_scheduler' (d270b961-28aa-4cbb-8398-ff784dbefd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:07:37.125532 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5700ffde-9053-41b2-bbd0-68ceef55bc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:37.129528 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5700ffde-9053-41b2-bbd0-68ceef55bc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(204f6ad7-69c1-4a6c-a74a-e603d27b5fe7),volume_id=204f6ad7-69c1-4a6c-a74a-e603d27b5fe7,volume_properties=VolumeProperties,volume_type=VolumeType(fc307699-9471-41c0-a876-42873e8c36f4))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:37.133387 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (70ed7aee-c487-4f63-b746-4a74e102801a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:37.142118 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:07:37.165243 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:07:37.165622 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:07:37.165976 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:37.166332 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:37.166686 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:37.167041 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] Filtering removed all hosts for the request with volume ID '204f6ad7-69c1-4a6c-a74a-e603d27b5fe7'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:07:37.167390 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] Filtering removed all hosts for the request with volume ID '204f6ad7-69c1-4a6c-a74a-e603d27b5fe7'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:07:37.167901 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] No weighed backend found for volume with properties: {'id': 'fc307699-9471-41c0-a876-42873e8c36f4', 'name': 'tempest-VolumeTypesTest-volume-type-1368799848', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'}, 'qos_specs_id': None, 'created_at': '2022-08-20T21:07:36.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:07:37.168329 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] Creating message record for request_id = req-422e4845-a21b-4379-9148-4babda3043e2 Aug 20 21:07:37.195974 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:07:37.196610 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] Setting Volume 204f6ad7-69c1-4a6c-a74a-e603d27b5fe7 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:07:37.208689 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (70ed7aee-c487-4f63-b746-4a74e102801a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:37.211897 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-422e4845-a21b-4379-9148-4babda3043e2 tempest-VolumeTypesTest-37032730 None] Flow 'volume_create_scheduler' (d270b961-28aa-4cbb-8398-ff784dbefd83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:07:43.038998 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] Flow 'volume_create_scheduler' (c9637669-6c79-4766-9849-24b2821eb5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:07:43.047425 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (888e3bc7-a841-4d00-b95e-8a9071e7dc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:43.053971 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (888e3bc7-a841-4d00-b95e-8a9071e7dc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b705e59d-dc70-4912-a761-3565e4443317),volume_id=b705e59d-dc70-4912-a761-3565e4443317,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:43.058932 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (dbcd245b-e4e6-4b3a-b1af-fd34593bde27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:43.069582 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:07:43.093152 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:07:43.093560 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:07:43.093915 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:43.094575 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:43.095101 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:43.098428 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] Filtering removed all hosts for the request with volume ID 'b705e59d-dc70-4912-a761-3565e4443317'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:07:43.099109 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] Filtering removed all hosts for the request with volume ID 'b705e59d-dc70-4912-a761-3565e4443317'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:07:43.100039 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:07:43.100681 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] Creating message record for request_id = req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b Aug 20 21:07:43.114438 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:07:43.115226 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] Setting Volume b705e59d-dc70-4912-a761-3565e4443317 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:07:43.156360 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (dbcd245b-e4e6-4b3a-b1af-fd34593bde27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:43.163213 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0f9d71a7-f6b0-4161-bc48-9039eaf6929b tempest-VolumesBackupsAdminTest-1761885982 None] Flow 'volume_create_scheduler' (c9637669-6c79-4766-9849-24b2821eb5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:07:44.518560 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] Flow 'volume_create_scheduler' (82e79e31-5fc3-41f5-ad07-8adb143c0995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:07:44.529560 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fa2a3323-aa55-46d7-bfdb-61d403e4da6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:44.533382 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fa2a3323-aa55-46d7-bfdb-61d403e4da6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(86d8d359-33af-4438-9fe0-b2869f8022a0),volume_id=86d8d359-33af-4438-9fe0-b2869f8022a0,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:44.537127 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (276660de-6bee-41eb-98c5-45859fc1d741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:44.545948 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:07:44.562056 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:07:44.562361 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:07:44.562710 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:44.563057 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:44.563394 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:44.563742 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] Filtering removed all hosts for the request with volume ID '86d8d359-33af-4438-9fe0-b2869f8022a0'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:07:44.564079 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] Filtering removed all hosts for the request with volume ID '86d8d359-33af-4438-9fe0-b2869f8022a0'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:07:44.564591 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:07:44.565241 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] Creating message record for request_id = req-004476f7-7f92-4bb3-a21a-652bdc67e48b Aug 20 21:07:44.574423 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:07:44.574855 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] Setting Volume 86d8d359-33af-4438-9fe0-b2869f8022a0 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:07:44.590319 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (276660de-6bee-41eb-98c5-45859fc1d741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:44.593472 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-004476f7-7f92-4bb3-a21a-652bdc67e48b tempest-VolumesBackupsAdminTest-1761885982 None] Flow 'volume_create_scheduler' (82e79e31-5fc3-41f5-ad07-8adb143c0995) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:07:49.186782 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] Flow 'volume_create_scheduler' (559ab774-7cd0-4b3e-aabe-5dc2899000e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:07:49.211867 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (348ef21d-cb56-44f3-b4bd-343d6abe65fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:49.211867 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (348ef21d-cb56-44f3-b4bd-343d6abe65fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=cdbd7b72-a449-4911-a314-de189b7a9b1c,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(74f09624-3b85-4960-a099-e39c4b4b0a5a),volume_id=74f09624-3b85-4960-a099-e39c4b4b0a5a,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:49.215579 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bdb2a637-6b4a-4124-a1c7-c0c339390b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:49.228410 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:07:49.261827 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:07:49.262190 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:07:49.262540 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:49.262882 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:49.263472 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:49.263913 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] Filtering removed all hosts for the request with volume ID '74f09624-3b85-4960-a099-e39c4b4b0a5a'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:07:49.264315 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] Filtering removed all hosts for the request with volume ID '74f09624-3b85-4960-a099-e39c4b4b0a5a'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:07:49.265028 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:07:49.265672 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] Creating message record for request_id = req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 Aug 20 21:07:49.273414 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:07:49.273946 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] Setting Volume 74f09624-3b85-4960-a099-e39c4b4b0a5a to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:07:49.285196 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bdb2a637-6b4a-4124-a1c7-c0c339390b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:49.290237 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-f49d9b22-015b-4cb9-8b09-59c0f11182d3 tempest-VolumesCloneTest-1773241061 None] Flow 'volume_create_scheduler' (559ab774-7cd0-4b3e-aabe-5dc2899000e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:07:50.607036 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] Flow 'volume_create_scheduler' (62b9404c-a327-46fc-8f98-2c063e903e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:07:50.611290 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8f4539ea-b256-4a2b-a396-30db57d6397a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:50.615362 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8f4539ea-b256-4a2b-a396-30db57d6397a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(91ad5c1f-0c71-4806-8463-7588bb8d5ac3),volume_id=91ad5c1f-0c71-4806-8463-7588bb8d5ac3,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:50.619320 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c4cbe3ce-da2f-4130-92a8-a45dbb559db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:50.649531 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:07:50.664933 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:07:50.665458 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:07:50.665814 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:50.666160 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:50.666500 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:50.666839 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] Filtering removed all hosts for the request with volume ID '91ad5c1f-0c71-4806-8463-7588bb8d5ac3'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:07:50.667178 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] Filtering removed all hosts for the request with volume ID '91ad5c1f-0c71-4806-8463-7588bb8d5ac3'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:07:50.667656 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:07:50.668071 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] Creating message record for request_id = req-a60e149f-4b5e-4602-b586-63d7ce185f6c Aug 20 21:07:50.676365 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:07:50.677267 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] Setting Volume 91ad5c1f-0c71-4806-8463-7588bb8d5ac3 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:07:50.690420 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c4cbe3ce-da2f-4130-92a8-a45dbb559db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:50.694041 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a60e149f-4b5e-4602-b586-63d7ce185f6c tempest-VolumesCloneTest-1773241061 None] Flow 'volume_create_scheduler' (62b9404c-a327-46fc-8f98-2c063e903e4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:07:53.379448 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=75,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=5 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:07:55.363521 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] Flow 'volume_create_scheduler' (0605d4d4-950d-41ad-ba68-06e219594ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:07:55.370885 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (662bd1aa-6f74-4b43-b6ba-2d5b5aa12cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:55.376352 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (662bd1aa-6f74-4b43-b6ba-2d5b5aa12cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(57acfa6e-49dc-44b6-8edd-2b0f058704eb),volume_id=57acfa6e-49dc-44b6-8edd-2b0f058704eb,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:55.380998 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2274bfc0-3f97-4655-b6dd-74bd69a75b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:55.393197 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:07:55.425715 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:07:55.426086 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:07:55.426473 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:55.426901 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:55.427595 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:55.427818 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] Filtering removed all hosts for the request with volume ID '57acfa6e-49dc-44b6-8edd-2b0f058704eb'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:07:55.428020 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] Filtering removed all hosts for the request with volume ID '57acfa6e-49dc-44b6-8edd-2b0f058704eb'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:07:55.428520 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:07:55.429297 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] Creating message record for request_id = req-46902961-f01a-4093-ad7d-6d62843dff4d Aug 20 21:07:55.442271 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:07:55.442898 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] Setting Volume 57acfa6e-49dc-44b6-8edd-2b0f058704eb to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:07:55.465900 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2274bfc0-3f97-4655-b6dd-74bd69a75b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:55.472269 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-46902961-f01a-4093-ad7d-6d62843dff4d tempest-VolumesGetTest-404092552 None] Flow 'volume_create_scheduler' (0605d4d4-950d-41ad-ba68-06e219594ec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:07:57.219439 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] Flow 'volume_create_scheduler' (2db2e739-9134-41ba-8959-64ab453b5f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:07:57.240726 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b52df999-0fd2-4446-8db5-d84c60f1acd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:57.246418 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b52df999-0fd2-4446-8db5-d84c60f1acd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(1254221d-a1b2-4dcd-af26-00fac913b572),volume_id=1254221d-a1b2-4dcd-af26-00fac913b572,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:57.250879 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (692e3c55-73e8-40b6-833a-3ad3eb8592cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:57.266140 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:07:57.281922 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:07:57.282350 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:07:57.282836 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:57.283201 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:57.283608 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:57.283963 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] Filtering removed all hosts for the request with volume ID '1254221d-a1b2-4dcd-af26-00fac913b572'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:07:57.284309 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] Filtering removed all hosts for the request with volume ID '1254221d-a1b2-4dcd-af26-00fac913b572'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:07:57.284820 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:07:57.285245 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] Creating message record for request_id = req-496139f6-3753-43d5-bbce-8e0042328574 Aug 20 21:07:57.294034 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:07:57.294685 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] Setting Volume 1254221d-a1b2-4dcd-af26-00fac913b572 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:07:57.307921 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (692e3c55-73e8-40b6-833a-3ad3eb8592cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:57.311485 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-496139f6-3753-43d5-bbce-8e0042328574 tempest-VolumesGetTest-404092552 None] Flow 'volume_create_scheduler' (2db2e739-9134-41ba-8959-64ab453b5f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:07:58.790596 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] Flow 'volume_create_scheduler' (c3bab354-fe20-4285-97f5-5ec851325317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:07:58.796508 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (896c9255-a020-408d-887c-f7382140e081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:58.801689 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (896c9255-a020-408d-887c-f7382140e081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=cdbd7b72-a449-4911-a314-de189b7a9b1c,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9dc52ca0-e706-4b03-ab84-96cf9d6c421a),volume_id=9dc52ca0-e706-4b03-ab84-96cf9d6c421a,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:58.805402 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a371d8b5-a7ba-4243-8a79-cc1704970a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:07:58.815659 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:07:58.836600 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:07:58.836600 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:07:58.836600 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:58.836600 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:58.836600 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:07:58.837258 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] Filtering removed all hosts for the request with volume ID '9dc52ca0-e706-4b03-ab84-96cf9d6c421a'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:07:58.837740 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] Filtering removed all hosts for the request with volume ID '9dc52ca0-e706-4b03-ab84-96cf9d6c421a'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:07:58.838248 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:07:58.840399 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] Creating message record for request_id = req-33d3b034-a242-4ff1-8785-9f72d0ced793 Aug 20 21:07:58.848653 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:07:58.849063 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] Setting Volume 9dc52ca0-e706-4b03-ab84-96cf9d6c421a to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:07:58.862176 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a371d8b5-a7ba-4243-8a79-cc1704970a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:07:58.866325 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-33d3b034-a242-4ff1-8785-9f72d0ced793 tempest-VolumesGetTest-404092552 None] Flow 'volume_create_scheduler' (c3bab354-fe20-4285-97f5-5ec851325317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:08:18.672709 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] Flow 'volume_create_scheduler' (9d6b6520-97db-46f0-8934-1ed683785ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:08:18.682310 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a3df7582-7c21-4970-83cf-2c17bd461093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:08:18.687054 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a3df7582-7c21-4970-83cf-2c17bd461093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=cdbd7b72-a449-4911-a314-de189b7a9b1c,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9028c65b-6e72-4834-861b-48067f727491),volume_id=9028c65b-6e72-4834-861b-48067f727491,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:08:18.692103 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9c8f6b55-e2c8-4b35-9da1-bd297bc153c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:08:18.704769 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:08:18.726291 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:08:18.726849 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:08:18.727525 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:08:18.728165 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:08:18.732859 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:08:18.735373 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] Filtering removed all hosts for the request with volume ID '9028c65b-6e72-4834-861b-48067f727491'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:08:18.735976 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] Filtering removed all hosts for the request with volume ID '9028c65b-6e72-4834-861b-48067f727491'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:08:18.736797 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:08:18.737899 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] Creating message record for request_id = req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 Aug 20 21:08:18.746729 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:08:18.747570 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] Setting Volume 9028c65b-6e72-4834-861b-48067f727491 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:08:18.768854 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9c8f6b55-e2c8-4b35-9da1-bd297bc153c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:08:18.774202 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2268cdb2-c167-4832-ad11-0b0bd36a48a3 tempest-TestVolumeBootPattern-559520958 None] Flow 'volume_create_scheduler' (9d6b6520-97db-46f0-8934-1ed683785ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:08:21.235347 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] Flow 'volume_create_scheduler' (5ecd319a-800b-4cd1-9af8-b2e7d47eed14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:08:21.266657 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (add965bf-5238-4aa1-94fc-d4eed3eeed38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:08:21.271088 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (add965bf-5238-4aa1-94fc-d4eed3eeed38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=cdbd7b72-a449-4911-a314-de189b7a9b1c,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(3e48e50a-1353-4f55-9dd6-3a3d33c8bd43),volume_id=3e48e50a-1353-4f55-9dd6-3a3d33c8bd43,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:08:21.292583 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a2437cd0-da83-4de0-8b6d-9dc422520cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:08:21.317632 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:08:21.376271 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:08:21.378629 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:08:21.379182 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:08:21.379722 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:08:21.382851 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:08:21.385927 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] Filtering removed all hosts for the request with volume ID '3e48e50a-1353-4f55-9dd6-3a3d33c8bd43'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:08:21.386475 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] Filtering removed all hosts for the request with volume ID '3e48e50a-1353-4f55-9dd6-3a3d33c8bd43'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:08:21.387166 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:08:21.389006 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] Creating message record for request_id = req-6823cbe6-ab59-47dc-921c-e06c5bb72326 Aug 20 21:08:21.409461 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:08:21.413602 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] Setting Volume 3e48e50a-1353-4f55-9dd6-3a3d33c8bd43 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:08:21.445685 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a2437cd0-da83-4de0-8b6d-9dc422520cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:08:21.454863 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-6823cbe6-ab59-47dc-921c-e06c5bb72326 tempest-TestVolumeBootPattern-559520958 None] Flow 'volume_create_scheduler' (5ecd319a-800b-4cd1-9af8-b2e7d47eed14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:08:26.526661 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=65,cinder:UPDATE=13,cinder:INSERT=5,cinder:DELETE=5 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:08:26.603903 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] Flow 'volume_create_scheduler' (9692ec3e-918f-428d-a5c9-b41c893e8a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:08:26.621378 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (eddc8630-2fc2-4531-a127-b4dea17f89e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:08:26.626641 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (eddc8630-2fc2-4531-a127-b4dea17f89e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=cdbd7b72-a449-4911-a314-de189b7a9b1c,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7a311753-6a14-4cc9-94ab-fcb16aa942c8),volume_id=7a311753-6a14-4cc9-94ab-fcb16aa942c8,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:08:26.648269 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f8c72175-0544-4ed8-95e5-f38fc6551d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:08:26.672820 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:08:26.726460 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:08:26.738942 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:08:26.739437 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:08:26.739802 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:08:26.740213 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:08:26.750107 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] Filtering removed all hosts for the request with volume ID '7a311753-6a14-4cc9-94ab-fcb16aa942c8'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:08:26.750559 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] Filtering removed all hosts for the request with volume ID '7a311753-6a14-4cc9-94ab-fcb16aa942c8'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:08:26.751081 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:08:26.751520 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] Creating message record for request_id = req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 Aug 20 21:08:26.776594 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:08:26.776976 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] Setting Volume 7a311753-6a14-4cc9-94ab-fcb16aa942c8 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:08:26.838993 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f8c72175-0544-4ed8-95e5-f38fc6551d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:08:26.865753 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-3012b694-75cc-47e1-9ad6-ab8dc3ab75b1 tempest-TestVolumeBootPattern-559520958 None] Flow 'volume_create_scheduler' (9692ec3e-918f-428d-a5c9-b41c893e8a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:08:26.883158 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-b198a0b0-ddf3-410c-bda5-fbae43169018 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:09:03.362739 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:09:26.881461 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-4616a27f-94d1-4ec4-a382-eda4e46a93d8 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:09:43.367156 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:10:23.360344 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:10:26.881428 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-5ee482db-e392-4741-97ab-75d2655e0245 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:10:39.453937 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-02f96bb1-dde9-4b92-9f54-568fd52049e9 tempest-GroupSnapshotsTest-1498147550 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:10:39.468740 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-02f96bb1-dde9-4b92-9f54-568fd52049e9 tempest-GroupSnapshotsTest-1498147550 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:10:39.469431 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.manager [None req-02f96bb1-dde9-4b92-9f54-568fd52049e9 tempest-GroupSnapshotsTest-1498147550 None] Could not find a backend for group e0cc3647-cbe5-47a9-85e0-7e2fdc9b48d8.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:10:41.109884 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-f6318df3-9c76-499f-b10d-55b54f7f4ae2 tempest-GroupSnapshotsTest-1498147550 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:10:41.140219 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-f6318df3-9c76-499f-b10d-55b54f7f4ae2 tempest-GroupSnapshotsTest-1498147550 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:10:41.140807 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.manager [None req-f6318df3-9c76-499f-b10d-55b54f7f4ae2 tempest-GroupSnapshotsTest-1498147550 None] Could not find a backend for group f60ccf1a-4ada-40fc-9283-b1f200a9a76b.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:10:42.675741 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-fc5ad0a9-78a2-4c54-828a-cdd74958f237 tempest-GroupSnapshotsTest-1498147550 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:10:42.683084 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-fc5ad0a9-78a2-4c54-828a-cdd74958f237 tempest-GroupSnapshotsTest-1498147550 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:10:42.683693 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.manager [None req-fc5ad0a9-78a2-4c54-828a-cdd74958f237 tempest-GroupSnapshotsTest-1498147550 None] Could not find a backend for group cdd60b7f-6917-46a0-a62b-034d4524cbd5.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:10:48.081265 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-0bf67501-3a53-43ce-9c22-cd3851b72b40 tempest-GroupsV314Test-768453583 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:10:48.090173 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-0bf67501-3a53-43ce-9c22-cd3851b72b40 tempest-GroupsV314Test-768453583 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:10:48.090704 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.manager [None req-0bf67501-3a53-43ce-9c22-cd3851b72b40 tempest-GroupsV314Test-768453583 None] Could not find a backend for group 018b3ed5-f87a-4469-850f-d8132d26fe9a.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:10:53.371952 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=29,cinder:UPDATE=7 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:10:53.680413 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-92d0867f-ea41-43b0-a32c-40262a48e80f tempest-GroupsV320Test-815664630 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:10:53.689960 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-92d0867f-ea41-43b0-a32c-40262a48e80f tempest-GroupsV320Test-815664630 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:10:53.690699 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.manager [None req-92d0867f-ea41-43b0-a32c-40262a48e80f tempest-GroupsV320Test-815664630 None] Could not find a backend for group 2c3e3158-7486-433b-b648-4da65f43f1b8.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:11:08.604595 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] Flow 'volume_create_scheduler' (be6b211c-73f7-4ef3-b163-9e09b7c64372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:11:08.609396 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a2282726-5c6d-4a3f-b14d-ae156caefc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:11:08.613883 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a2282726-5c6d-4a3f-b14d-ae156caefc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a2cef751-5f8f-4adb-9741-703da7f65e23),volume_id=a2cef751-5f8f-4adb-9741-703da7f65e23,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:11:08.617814 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (029c9aa5-74ff-4cc5-b976-7789c9af6c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:11:08.626910 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:11:08.644326 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:11:08.645295 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:11:08.645956 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:08.646789 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:08.647368 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:08.648211 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] Filtering removed all hosts for the request with volume ID 'a2cef751-5f8f-4adb-9741-703da7f65e23'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:11:08.648847 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] Filtering removed all hosts for the request with volume ID 'a2cef751-5f8f-4adb-9741-703da7f65e23'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:11:08.649588 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:11:08.650762 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] Creating message record for request_id = req-14904e4f-ca92-40d4-8572-77eb8ac14b3d Aug 20 21:11:08.661575 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:11:08.661957 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] Setting Volume a2cef751-5f8f-4adb-9741-703da7f65e23 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:11:08.685332 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (029c9aa5-74ff-4cc5-b976-7789c9af6c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:11:08.692095 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-14904e4f-ca92-40d4-8572-77eb8ac14b3d tempest-VolumeQuotasNegativeTestJSON-788292383 None] Flow 'volume_create_scheduler' (be6b211c-73f7-4ef3-b163-9e09b7c64372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:11:23.395888 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=27,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:11:24.569830 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] Flow 'volume_create_scheduler' (1f5313dd-aeeb-444f-9fce-2f6320b18fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:11:24.576008 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (12e6f437-c7e1-427d-ad49-673fadfab478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:11:24.582860 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (12e6f437-c7e1-427d-ad49-673fadfab478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(aa5d621d-3bff-42ec-8107-c14870fb09fe),volume_id=aa5d621d-3bff-42ec-8107-c14870fb09fe,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:11:24.587442 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cded998f-fd88-49c5-9eaa-08a4154fffba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:11:24.597026 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:11:24.618949 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:11:24.619325 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:11:24.619742 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:24.620133 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:24.620743 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:24.621114 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] Filtering removed all hosts for the request with volume ID 'aa5d621d-3bff-42ec-8107-c14870fb09fe'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:11:24.621716 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] Filtering removed all hosts for the request with volume ID 'aa5d621d-3bff-42ec-8107-c14870fb09fe'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:11:24.622306 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:11:24.622791 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] Creating message record for request_id = req-16210ead-9e3c-47e4-85b0-18698643950e Aug 20 21:11:24.634494 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:11:24.634986 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] Setting Volume aa5d621d-3bff-42ec-8107-c14870fb09fe to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:11:24.652290 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cded998f-fd88-49c5-9eaa-08a4154fffba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:11:24.656689 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [req-053ad616-1374-45f7-8ba7-39e5da008778 req-16210ead-9e3c-47e4-85b0-18698643950e tempest-VolumesSnapshotsTestJSON-1684983961 None] Flow 'volume_create_scheduler' (1f5313dd-aeeb-444f-9fce-2f6320b18fa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:11:26.879886 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-bb855eaa-79fc-4c79-b65c-c02423bba137 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:11:29.472422 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] Flow 'volume_create_scheduler' (a62cccc1-ff5e-4eae-a7a2-19754de67c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:11:29.476737 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2ddaca02-f23e-4f1e-bfde-aed705c2f6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:11:29.480740 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2ddaca02-f23e-4f1e-bfde-aed705c2f6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=cdbd7b72-a449-4911-a314-de189b7a9b1c,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(29f810dc-8de2-4590-b9c2-8d487c1747df),volume_id=29f810dc-8de2-4590-b9c2-8d487c1747df,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:11:29.484114 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2ca31669-9d1b-4106-9f63-5d30c1010ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:11:29.503824 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:11:29.520586 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:11:29.521090 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:11:29.521712 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:29.522460 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:29.522930 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:29.523403 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] Filtering removed all hosts for the request with volume ID '29f810dc-8de2-4590-b9c2-8d487c1747df'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:11:29.523870 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] Filtering removed all hosts for the request with volume ID '29f810dc-8de2-4590-b9c2-8d487c1747df'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:11:29.524512 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:11:29.525084 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] Creating message record for request_id = req-b70831f6-cdad-4c1f-a613-527a84c5fa58 Aug 20 21:11:29.535890 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:11:29.536497 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] Setting Volume 29f810dc-8de2-4590-b9c2-8d487c1747df to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:11:29.556176 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2ca31669-9d1b-4106-9f63-5d30c1010ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:11:29.559451 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-b70831f6-cdad-4c1f-a613-527a84c5fa58 tempest-VolumesImageMetadata-236256740 None] Flow 'volume_create_scheduler' (a62cccc1-ff5e-4eae-a7a2-19754de67c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:11:29.850192 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] Flow 'volume_create_scheduler' (3b2d4c3d-adc6-41a3-9289-a668651e8d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:11:29.865561 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5012e90b-a147-42be-b501-225259acdeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:11:29.865561 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5012e90b-a147-42be-b501-225259acdeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ddd70cd9-6bb7-4307-b170-4d8a8454d155),volume_id=ddd70cd9-6bb7-4307-b170-4d8a8454d155,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:11:29.865561 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (40474d82-9fc6-44da-9e16-79a30bc93bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:11:29.872966 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:11:29.887688 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:11:29.888219 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:11:29.888596 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:29.888939 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:29.889276 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:29.889618 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] Filtering removed all hosts for the request with volume ID 'ddd70cd9-6bb7-4307-b170-4d8a8454d155'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:11:29.889953 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] Filtering removed all hosts for the request with volume ID 'ddd70cd9-6bb7-4307-b170-4d8a8454d155'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:11:29.891100 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:11:29.891532 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] Creating message record for request_id = req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 Aug 20 21:11:29.901816 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:11:29.902320 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] Setting Volume ddd70cd9-6bb7-4307-b170-4d8a8454d155 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:11:29.916822 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (40474d82-9fc6-44da-9e16-79a30bc93bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:11:29.920173 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [req-b47e5f2c-86f2-4df3-8101-1a41e13da913 req-9036120a-8ed0-48a2-b2a4-a7e68fdb95b0 tempest-VolumesGetTestJSON-1423403275 None] Flow 'volume_create_scheduler' (3b2d4c3d-adc6-41a3-9289-a668651e8d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:11:33.999160 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] Flow 'volume_create_scheduler' (47145d2e-4b27-4421-a33d-b95b9b82152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:11:34.004728 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (17919c3f-71b0-4bbd-b852-d4fb0ec25524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:11:34.009179 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (17919c3f-71b0-4bbd-b852-d4fb0ec25524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(29b8dd60-569b-481f-bda3-d0eb94dce6b7),volume_id=29b8dd60-569b-481f-bda3-d0eb94dce6b7,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:11:34.013711 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4fd27f63-3170-43ef-ad1a-17aee8459634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:11:34.023770 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:11:34.041173 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:11:34.041723 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:11:34.042339 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:34.042890 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:34.043545 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:34.044064 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] Filtering removed all hosts for the request with volume ID '29b8dd60-569b-481f-bda3-d0eb94dce6b7'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:11:34.044606 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] Filtering removed all hosts for the request with volume ID '29b8dd60-569b-481f-bda3-d0eb94dce6b7'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:11:34.045298 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:11:34.045806 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] Creating message record for request_id = req-324e6b12-3949-47fb-8c3e-621df0811a47 Aug 20 21:11:34.068095 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:11:34.068719 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] Setting Volume 29b8dd60-569b-481f-bda3-d0eb94dce6b7 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:11:34.087539 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4fd27f63-3170-43ef-ad1a-17aee8459634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:11:34.092036 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-324e6b12-3949-47fb-8c3e-621df0811a47 tempest-VolumesListTestJSON-355399066 None] Flow 'volume_create_scheduler' (47145d2e-4b27-4421-a33d-b95b9b82152a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:11:37.867123 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] Flow 'volume_create_scheduler' (fccd4a53-00e3-449e-9251-256dc3330319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:11:37.872442 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (72ed99a4-f965-4820-a9ab-68d908f97179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:11:37.876775 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (72ed99a4-f965-4820-a9ab-68d908f97179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bc4b67b3-c8ef-46a7-9b74-2fca7ec01b0d),volume_id=bc4b67b3-c8ef-46a7-9b74-2fca7ec01b0d,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:11:37.880601 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4839e604-f595-4d0b-a7ab-0015748677d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:11:37.889135 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:11:37.904618 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:11:37.905351 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:11:37.906002 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:37.906488 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:37.906964 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:11:37.907447 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] Filtering removed all hosts for the request with volume ID 'bc4b67b3-c8ef-46a7-9b74-2fca7ec01b0d'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:11:37.907924 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] Filtering removed all hosts for the request with volume ID 'bc4b67b3-c8ef-46a7-9b74-2fca7ec01b0d'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:11:37.908801 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:11:37.909381 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] Creating message record for request_id = req-0fff8818-364e-4ef0-9528-2f44255246b8 Aug 20 21:11:37.920781 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:11:37.921983 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] Setting Volume bc4b67b3-c8ef-46a7-9b74-2fca7ec01b0d to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:11:37.957503 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4839e604-f595-4d0b-a7ab-0015748677d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:11:37.964948 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0fff8818-364e-4ef0-9528-2f44255246b8 tempest-VolumesSnapshotListTestJSON-649478780 None] Flow 'volume_create_scheduler' (fccd4a53-00e3-449e-9251-256dc3330319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:12:03.388609 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=14,cinder:SELECT=65,cinder:INSERT=5,cinder:DELETE=5 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:12:26.877247 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-799bb854-3150-4425-9c5b-a2bc434c8716 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:12:43.388883 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:13:23.390915 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:13:26.871941 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-0ed07ad0-0bde-4efe-9cb6-e17a05d25e0d None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:13:50.106067 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] Flow 'volume_create_scheduler' (fd2b29fe-276b-474d-97d0-de4f2d9992d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:13:50.110891 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9c879f19-d987-46c4-b8e8-6fa38bfe94fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:13:50.117086 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9c879f19-d987-46c4-b8e8-6fa38bfe94fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c9e6752f-69c9-489a-b08e-1bd6d65b231f),volume_id=c9e6752f-69c9-489a-b08e-1bd6d65b231f,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:13:50.127436 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8d812fe3-cdbe-48cc-a5f1-0b2617bfb900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:13:50.141228 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:13:50.174264 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:13:50.174634 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:13:50.175183 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:13:50.175541 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:13:50.175880 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:13:50.176430 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] Filtering removed all hosts for the request with volume ID 'c9e6752f-69c9-489a-b08e-1bd6d65b231f'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:13:50.176980 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] Filtering removed all hosts for the request with volume ID 'c9e6752f-69c9-489a-b08e-1bd6d65b231f'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:13:50.177613 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:13:50.178324 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] Creating message record for request_id = req-d7b08319-7e78-49c9-b572-f350bdd9032c Aug 20 21:13:50.190316 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:13:50.191005 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] Setting Volume c9e6752f-69c9-489a-b08e-1bd6d65b231f to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:13:50.209402 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8d812fe3-cdbe-48cc-a5f1-0b2617bfb900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:13:50.217733 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d7b08319-7e78-49c9-b572-f350bdd9032c tempest-AttachVolumeShelveTestJSON-1247298561 None] Flow 'volume_create_scheduler' (fd2b29fe-276b-474d-97d0-de4f2d9992d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:13:53.411045 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=22,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:14:26.878345 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-61b341f0-ec47-456e-b232-3d38252ea18b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:14:33.413947 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:14:55.098836 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] Flow 'volume_create_scheduler' (36363d65-4753-43d4-92e0-15d3a9af73f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:14:55.117724 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2258f2d3-b940-4a1d-a536-6c0339ec84fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:14:55.129749 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2258f2d3-b940-4a1d-a536-6c0339ec84fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(159495b4-580f-4349-9651-f9a0de832eaa),volume_id=159495b4-580f-4349-9651-f9a0de832eaa,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:14:55.144564 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ceeeb131-8319-4055-bc19-ff6f64eef23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:14:55.157568 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:14:55.195563 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:14:55.196712 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:14:55.198369 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:14:55.198904 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:14:55.201419 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:14:55.202434 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] Filtering removed all hosts for the request with volume ID '159495b4-580f-4349-9651-f9a0de832eaa'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:14:55.202952 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] Filtering removed all hosts for the request with volume ID '159495b4-580f-4349-9651-f9a0de832eaa'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:14:55.203617 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:14:55.204212 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] Creating message record for request_id = req-4e257907-9d32-409c-bf01-4e85d2d258a1 Aug 20 21:14:55.220155 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:14:55.220514 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] Setting Volume 159495b4-580f-4349-9651-f9a0de832eaa to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:14:55.238475 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ceeeb131-8319-4055-bc19-ff6f64eef23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:14:55.242258 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-4e257907-9d32-409c-bf01-4e85d2d258a1 tempest-AttachVolumeShelveTestJSON-1247298561 None] Flow 'volume_create_scheduler' (36363d65-4753-43d4-92e0-15d3a9af73f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:15:13.415585 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:15:26.878044 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-64f8d9b2-d77d-4ab2-83c9-0af0b997ee1a None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:15:43.425786 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:16:19.428875 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:16:19.506880 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] Flow 'volume_create_scheduler' (97b4bead-85a5-4946-85aa-f92bcad28223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:16:19.515045 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8e3072d3-449b-4cbd-a672-e2f04453f12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:16:19.529858 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8e3072d3-449b-4cbd-a672-e2f04453f12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c9ae26c1-097d-40a5-b4fc-ecc234fafbfc),volume_id=c9ae26c1-097d-40a5-b4fc-ecc234fafbfc,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:16:19.534490 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0dc7ada8-fe12-4be3-95ad-63ec1c680949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:16:19.544434 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:16:19.566717 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:16:19.567394 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:16:19.567890 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:16:19.568410 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:16:19.569910 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:16:19.570411 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] Filtering removed all hosts for the request with volume ID 'c9ae26c1-097d-40a5-b4fc-ecc234fafbfc'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:16:19.570922 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] Filtering removed all hosts for the request with volume ID 'c9ae26c1-097d-40a5-b4fc-ecc234fafbfc'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:16:19.571607 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:16:19.572464 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] Creating message record for request_id = req-da829a4b-18c1-4d2d-849d-befe62e24065 Aug 20 21:16:19.584089 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:16:19.584676 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] Setting Volume c9ae26c1-097d-40a5-b4fc-ecc234fafbfc to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:16:19.605150 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0dc7ada8-fe12-4be3-95ad-63ec1c680949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:16:19.608587 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-da829a4b-18c1-4d2d-849d-befe62e24065 tempest-AttachVolumeTestJSON-982979521 None] Flow 'volume_create_scheduler' (97b4bead-85a5-4946-85aa-f92bcad28223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:16:26.871760 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-1edb234c-15a1-40d8-bc4a-3ac1b01aeff2 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:16:53.424183 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:17:26.870192 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-43d8ba07-c29d-45f2-9cc6-58696cac065d None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:17:33.425452 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:17:38.129741 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] Flow 'volume_create_scheduler' (98f01e88-5530-418d-8aaf-f320930615b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:17:38.134202 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2a42415d-d504-4897-89ce-0a5d6d78f7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:17:38.138744 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2a42415d-d504-4897-89ce-0a5d6d78f7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b99d19b6-e61a-4448-9c01-51e48c0a8f94),volume_id=b99d19b6-e61a-4448-9c01-51e48c0a8f94,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:17:38.142120 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (72e970ea-7423-4b39-98c6-c704f4221d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:17:38.151370 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:17:38.165453 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:17:38.166099 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:17:38.166602 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:17:38.167102 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:17:38.167784 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:17:38.168288 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] Filtering removed all hosts for the request with volume ID 'b99d19b6-e61a-4448-9c01-51e48c0a8f94'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:17:38.168921 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] Filtering removed all hosts for the request with volume ID 'b99d19b6-e61a-4448-9c01-51e48c0a8f94'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:17:38.169573 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:17:38.170162 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] Creating message record for request_id = req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 Aug 20 21:17:38.178617 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:17:38.179230 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] Setting Volume b99d19b6-e61a-4448-9c01-51e48c0a8f94 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:17:38.193426 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (72e970ea-7423-4b39-98c6-c704f4221d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:17:38.198968 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ecbb9cb7-f32a-401b-9a9c-29c4661954a5 tempest-AttachVolumeTestJSON-982979521 None] Flow 'volume_create_scheduler' (98f01e88-5530-418d-8aaf-f320930615b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:18:01.895010 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] Flow 'volume_create_scheduler' (659a8287-0050-437e-9dde-444469286abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:18:01.899912 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (82c11210-ed15-4a7d-b9af-369d7661c081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:18:01.929008 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (82c11210-ed15-4a7d-b9af-369d7661c081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c8881e68-9030-4737-89fe-c56c046c29da),volume_id=c8881e68-9030-4737-89fe-c56c046c29da,volume_properties=VolumeProperties,volume_type=VolumeType(c9b436a0-2691-4151-8884-8e0c1acce638))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:18:01.943322 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1c7a9127-62fe-4bc8-9f23-0a4e28c94f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:18:01.962288 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:18:01.987035 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:18:01.987816 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:18:01.988396 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:18:01.989266 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:18:01.989895 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:18:01.990467 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] Filtering removed all hosts for the request with volume ID 'c8881e68-9030-4737-89fe-c56c046c29da'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:18:01.991127 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] Filtering removed all hosts for the request with volume ID 'c8881e68-9030-4737-89fe-c56c046c29da'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:18:01.992700 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] No weighed backend found for volume with properties: {'id': 'c9b436a0-2691-4151-8884-8e0c1acce638', 'name': 'volume-type-1', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {}, 'qos_specs_id': None, 'created_at': '2022-08-20T21:18:01.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:18:01.993425 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] Creating message record for request_id = req-72be1852-0e8d-4243-bacc-a6d78003447b Aug 20 21:18:02.005977 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:18:02.008260 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] Setting Volume c8881e68-9030-4737-89fe-c56c046c29da to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:18:02.028225 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1c7a9127-62fe-4bc8-9f23-0a4e28c94f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:18:02.036752 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-72be1852-0e8d-4243-bacc-a6d78003447b tempest-VolumeRetypeWithoutMigrationTest-187009065 None] Flow 'volume_create_scheduler' (659a8287-0050-437e-9dde-444469286abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:18:11.392703 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=34,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:18:11.443319 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] Flow 'volume_create_scheduler' (c7b6fdde-06a9-4b85-8b5c-f9cc33186dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:18:11.450628 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9890fa03-570c-4844-be6e-12a53367adf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:18:11.455500 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9890fa03-570c-4844-be6e-12a53367adf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(48b78919-d7df-4c2f-9a34-3fc6e91c8593),volume_id=48b78919-d7df-4c2f-9a34-3fc6e91c8593,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:18:11.466713 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ea6513b2-0878-4857-ad70-508956221695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:18:11.478522 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:18:11.501397 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:18:11.501764 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:18:11.502123 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:18:11.502922 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:18:11.503449 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:18:11.503812 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] Filtering removed all hosts for the request with volume ID '48b78919-d7df-4c2f-9a34-3fc6e91c8593'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:18:11.504159 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] Filtering removed all hosts for the request with volume ID '48b78919-d7df-4c2f-9a34-3fc6e91c8593'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:18:11.504680 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:18:11.505109 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] Creating message record for request_id = req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d Aug 20 21:18:11.518877 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:18:11.519150 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] Setting Volume 48b78919-d7df-4c2f-9a34-3fc6e91c8593 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:18:11.538300 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ea6513b2-0878-4857-ad70-508956221695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:18:11.542905 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ab3c41d1-2dfa-4d6e-bcca-d8028ad6881d tempest-SnapshotMetadataTestJSON-162595550 None] Flow 'volume_create_scheduler' (c7b6fdde-06a9-4b85-8b5c-f9cc33186dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:18:18.229387 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] Flow 'volume_create_scheduler' (c851a2b1-5537-4453-8edd-8ec441d09643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:18:18.238341 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5f89e493-5478-4e6b-8348-ede3c5a174fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:18:18.248351 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5f89e493-5478-4e6b-8348-ede3c5a174fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(14c524bb-1c54-481d-87ee-02909df73d71),volume_id=14c524bb-1c54-481d-87ee-02909df73d71,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:18:18.257986 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8f39266c-f47a-4f60-a255-e2399c1eb288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:18:18.269070 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:18:18.295022 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:18:18.295552 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:18:18.296708 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:18:18.297290 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:18:18.297874 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:18:18.298425 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] Filtering removed all hosts for the request with volume ID '14c524bb-1c54-481d-87ee-02909df73d71'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:18:18.299117 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] Filtering removed all hosts for the request with volume ID '14c524bb-1c54-481d-87ee-02909df73d71'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:18:18.299899 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:18:18.300687 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] Creating message record for request_id = req-eb27d95a-0e46-43a8-843f-449bb288c18f Aug 20 21:18:18.321738 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:18:18.322529 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] Setting Volume 14c524bb-1c54-481d-87ee-02909df73d71 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:18:18.352887 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8f39266c-f47a-4f60-a255-e2399c1eb288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:18:18.359879 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-eb27d95a-0e46-43a8-843f-449bb288c18f tempest-AbsoluteLimitsTests-220867006 None] Flow 'volume_create_scheduler' (c851a2b1-5537-4453-8edd-8ec441d09643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:18:25.334411 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] Flow 'volume_create_scheduler' (6a50dd65-e0ab-499e-bc03-229284a0a3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:18:25.345707 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (aee4e9e3-7121-44a1-86df-384be74d594a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:18:25.352883 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (aee4e9e3-7121-44a1-86df-384be74d594a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5ed9371a-e41f-447b-8fe0-ecc9c71e5d15),volume_id=5ed9371a-e41f-447b-8fe0-ecc9c71e5d15,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:18:25.360227 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ccf710f2-9476-46a1-9fa2-961d3f40b042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:18:25.380698 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:18:25.416020 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:18:25.416020 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:18:25.416020 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:18:25.416020 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:18:25.416020 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:18:25.416020 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] Filtering removed all hosts for the request with volume ID '5ed9371a-e41f-447b-8fe0-ecc9c71e5d15'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:18:25.416923 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] Filtering removed all hosts for the request with volume ID '5ed9371a-e41f-447b-8fe0-ecc9c71e5d15'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:18:25.416923 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:18:25.416923 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] Creating message record for request_id = req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb Aug 20 21:18:25.421960 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:18:25.422395 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] Setting Volume 5ed9371a-e41f-447b-8fe0-ecc9c71e5d15 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:18:25.438576 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ccf710f2-9476-46a1-9fa2-961d3f40b042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:18:25.441633 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-1ecb6e49-a445-4d1c-b1d5-86bfc13ef6bb tempest-VolumesActionsTest-594915483 None] Flow 'volume_create_scheduler' (6a50dd65-e0ab-499e-bc03-229284a0a3b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:18:26.867981 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-42063a61-d329-42b9-8237-0f9d8d89c7f9 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:18:43.421613 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=42,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:18:55.801652 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] Flow 'volume_create_scheduler' (cfbfc808-a59c-4c19-813c-b877b86cd109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:18:55.805691 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (61573d94-2159-46fd-a8f2-c6b26403196a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:18:55.809483 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (61573d94-2159-46fd-a8f2-c6b26403196a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b7fe77af-aaf2-4f7d-bd6a-90f1b9defa45),volume_id=b7fe77af-aaf2-4f7d-bd6a-90f1b9defa45,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:18:55.812813 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (08f90201-7609-4084-b93c-51724ca127d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:18:55.821739 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:18:55.837616 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:18:55.838073 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:18:55.838496 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:18:55.839010 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:18:55.839376 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:18:55.839781 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] Filtering removed all hosts for the request with volume ID 'b7fe77af-aaf2-4f7d-bd6a-90f1b9defa45'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:18:55.840200 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] Filtering removed all hosts for the request with volume ID 'b7fe77af-aaf2-4f7d-bd6a-90f1b9defa45'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:18:55.840779 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:18:55.841213 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] Creating message record for request_id = req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 Aug 20 21:18:55.849322 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:18:55.849886 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] Setting Volume b7fe77af-aaf2-4f7d-bd6a-90f1b9defa45 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:18:55.862982 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (08f90201-7609-4084-b93c-51724ca127d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:18:55.866197 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d06bdc7b-cfd9-4d80-ad9b-20986b8e7ed3 tempest-VolumesServicesTestJSON-46899617 None] Flow 'volume_create_scheduler' (cfbfc808-a59c-4c19-813c-b877b86cd109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:19:01.735962 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] Flow 'volume_create_scheduler' (240bdcaf-d66d-4ea1-a2a7-ec5ebb5e5074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:19:01.740577 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c03131a1-f5ba-4fcb-86fd-15b943eeb941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:19:01.745107 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c03131a1-f5ba-4fcb-86fd-15b943eeb941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(009a5c11-3f11-4707-9238-bf7c481f7234),volume_id=009a5c11-3f11-4707-9238-bf7c481f7234,volume_properties=VolumeProperties,volume_type=VolumeType(02a918bf-966d-417a-9c9f-a061da93e222))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:19:01.748488 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c8eaf729-2ec7-4354-b2b5-ce7d25874bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:19:01.757423 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:19:01.771206 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:19:01.771570 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:19:01.772335 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:19:01.772807 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:19:01.773157 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:19:01.773508 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] Filtering removed all hosts for the request with volume ID '009a5c11-3f11-4707-9238-bf7c481f7234'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:19:01.773863 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] Filtering removed all hosts for the request with volume ID '009a5c11-3f11-4707-9238-bf7c481f7234'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:19:01.774342 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] No weighed backend found for volume with properties: {'id': '02a918bf-966d-417a-9c9f-a061da93e222', 'name': 'tempest-VolumeTypesAccessTest-volume-type-2031953525', 'description': None, 'is_public': False, 'projects': [], 'extra_specs': {}, 'qos_specs_id': None, 'created_at': '2022-08-20T21:19:01.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:19:01.774761 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] Creating message record for request_id = req-8f097ab6-1dd6-4b84-817f-ac6396019a6e Aug 20 21:19:01.782220 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:19:01.782589 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] Setting Volume 009a5c11-3f11-4707-9238-bf7c481f7234 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:19:01.794210 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c8eaf729-2ec7-4354-b2b5-ce7d25874bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:19:01.797596 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-8f097ab6-1dd6-4b84-817f-ac6396019a6e tempest-VolumeTypesAccessTest-759935584 None] Flow 'volume_create_scheduler' (240bdcaf-d66d-4ea1-a2a7-ec5ebb5e5074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:19:07.076026 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] Flow 'volume_create_scheduler' (64529071-cc36-4ed2-a2eb-a9e08541aaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:19:07.080637 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a1e2603d-3476-4995-a5fb-bc566eac5c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:19:07.084732 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a1e2603d-3476-4995-a5fb-bc566eac5c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(fab7c4d2-683f-488e-a2b9-a3d0523a69de),volume_id=fab7c4d2-683f-488e-a2b9-a3d0523a69de,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:19:07.088684 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7075716c-6558-4c54-bcd6-ba389b8024bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:19:07.098574 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:19:07.113813 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:19:07.114250 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:19:07.114718 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:19:07.115117 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:19:07.115518 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:19:07.127572 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] Filtering removed all hosts for the request with volume ID 'fab7c4d2-683f-488e-a2b9-a3d0523a69de'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:19:07.127572 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] Filtering removed all hosts for the request with volume ID 'fab7c4d2-683f-488e-a2b9-a3d0523a69de'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:19:07.127572 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:19:07.127572 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] Creating message record for request_id = req-96e711bd-7d34-4080-88cd-b56f17e1807f Aug 20 21:19:07.128190 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:19:07.128788 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] Setting Volume fab7c4d2-683f-488e-a2b9-a3d0523a69de to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:19:07.142698 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7075716c-6558-4c54-bcd6-ba389b8024bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:19:07.146552 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-96e711bd-7d34-4080-88cd-b56f17e1807f tempest-VolumesDeleteCascade-525810670 None] Flow 'volume_create_scheduler' (64529071-cc36-4ed2-a2eb-a9e08541aaa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:19:10.807131 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] Flow 'volume_create_scheduler' (1c8eb7b7-7a94-404a-83f6-c38666a9cc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:19:10.811342 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (16577e3e-22bd-4f8e-88cd-2e735f66f3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:19:10.815714 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (16577e3e-22bd-4f8e-88cd-2e735f66f3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(60d62599-e3f6-41c4-81db-02d21635695f),volume_id=60d62599-e3f6-41c4-81db-02d21635695f,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:19:10.822259 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7ff3fec0-f6ac-4de7-b542-ee0fce593334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:19:10.832830 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:19:10.847830 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:19:10.848240 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:19:10.848612 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:19:10.848949 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:19:10.849513 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:19:10.849967 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] Filtering removed all hosts for the request with volume ID '60d62599-e3f6-41c4-81db-02d21635695f'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:19:10.850379 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] Filtering removed all hosts for the request with volume ID '60d62599-e3f6-41c4-81db-02d21635695f'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:19:10.850938 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:19:10.851647 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] Creating message record for request_id = req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 Aug 20 21:19:10.872769 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:19:10.873025 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] Setting Volume 60d62599-e3f6-41c4-81db-02d21635695f to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:19:10.885283 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7ff3fec0-f6ac-4de7-b542-ee0fce593334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:19:10.888960 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-98828e1c-55f1-4ccd-bc00-0ad0e5b22293 tempest-VolumesNegativeTest-2104799891 None] Flow 'volume_create_scheduler' (1c8eb7b7-7a94-404a-83f6-c38666a9cc9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:19:13.481177 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=56,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:19:13.527227 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] Flow 'volume_create_scheduler' (ddab6ec4-d429-4ff4-8e14-2efc8d4e2262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:19:13.535857 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3424c5a6-2a6b-4162-8fb4-3ba5698e9665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:19:13.545906 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3424c5a6-2a6b-4162-8fb4-3ba5698e9665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(79f4c5dd-9b67-4ad3-8402-fc91fc34dc24),volume_id=79f4c5dd-9b67-4ad3-8402-fc91fc34dc24,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:19:13.551962 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4ed8b40d-6475-452a-b8df-109a9271c409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:19:13.564169 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:19:13.585010 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:19:13.585576 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:19:13.586137 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:19:13.586633 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:19:13.587133 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:19:13.587631 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] Filtering removed all hosts for the request with volume ID '79f4c5dd-9b67-4ad3-8402-fc91fc34dc24'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:19:13.588118 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] Filtering removed all hosts for the request with volume ID '79f4c5dd-9b67-4ad3-8402-fc91fc34dc24'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:19:13.588878 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:19:13.589582 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] Creating message record for request_id = req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 Aug 20 21:19:13.600269 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:19:13.600947 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] Setting Volume 79f4c5dd-9b67-4ad3-8402-fc91fc34dc24 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:19:13.614756 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4ed8b40d-6475-452a-b8df-109a9271c409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:19:13.618403 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a21bfb37-e2dd-4b70-9dc9-3c498d2d4936 tempest-AttachVolumeNegativeTest-209157223 None] Flow 'volume_create_scheduler' (ddab6ec4-d429-4ff4-8e14-2efc8d4e2262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:19:26.871834 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-961336a6-7cfc-4b5d-bafd-d6957e5601e6 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:19:53.439332 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:20:17.020099 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] Flow 'volume_create_scheduler' (e70fe5b8-8c1a-4ab5-9d7b-4bf92c499f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:20:17.026935 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c07d1ac4-4a50-489a-a414-20833fa3405c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:20:17.031402 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c07d1ac4-4a50-489a-a414-20833fa3405c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(66eeb408-1879-499d-b7b0-985558837a17),volume_id=66eeb408-1879-499d-b7b0-985558837a17,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:20:17.035173 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c51c8a4b-0bd0-41c8-8543-fb733cf016fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:20:17.044882 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:20:17.060733 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:20:17.061563 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:20:17.062070 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:20:17.062587 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:20:17.063088 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:20:17.063852 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] Filtering removed all hosts for the request with volume ID '66eeb408-1879-499d-b7b0-985558837a17'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:20:17.064539 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] Filtering removed all hosts for the request with volume ID '66eeb408-1879-499d-b7b0-985558837a17'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:20:17.065201 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:20:17.065781 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] Creating message record for request_id = req-d8b1b469-85c0-49c9-8a5b-45202b62884d Aug 20 21:20:17.082100 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:20:17.082816 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] Setting Volume 66eeb408-1879-499d-b7b0-985558837a17 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:20:17.102440 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c51c8a4b-0bd0-41c8-8543-fb733cf016fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:20:17.107818 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d8b1b469-85c0-49c9-8a5b-45202b62884d tempest-AttachVolumeNegativeTest-209157223 None] Flow 'volume_create_scheduler' (e70fe5b8-8c1a-4ab5-9d7b-4bf92c499f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:20:17.202528 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] Flow 'volume_create_scheduler' (8c99435e-7dd0-4a51-a69d-ae21af338909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:20:17.206663 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (29b08c92-aab7-453c-9430-75dd2f4aa134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:20:17.211299 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (29b08c92-aab7-453c-9430-75dd2f4aa134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=cdbd7b72-a449-4911-a314-de189b7a9b1c,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(6557d5ea-95b9-43eb-a358-620e56572584),volume_id=6557d5ea-95b9-43eb-a358-620e56572584,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:20:17.214966 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cf1cd88e-a9ce-44b8-bb5d-60e07016ddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:20:17.225600 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:20:17.245831 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:20:17.246481 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:20:17.246856 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:20:17.247180 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:20:17.247561 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:20:17.247934 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] Filtering removed all hosts for the request with volume ID '6557d5ea-95b9-43eb-a358-620e56572584'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:20:17.248346 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] Filtering removed all hosts for the request with volume ID '6557d5ea-95b9-43eb-a358-620e56572584'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:20:17.249001 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:20:17.249458 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] Creating message record for request_id = req-1375d77a-a22c-4be1-9f43-6f2792a87558 Aug 20 21:20:17.257395 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:20:17.259538 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] Setting Volume 6557d5ea-95b9-43eb-a358-620e56572584 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:20:17.272325 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cf1cd88e-a9ce-44b8-bb5d-60e07016ddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:20:17.276162 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-1375d77a-a22c-4be1-9f43-6f2792a87558 tempest-ServersTestBootFromVolume-1058348954 None] Flow 'volume_create_scheduler' (8c99435e-7dd0-4a51-a69d-ae21af338909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:20:26.874428 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-cbdd0016-510e-4d01-96ce-e2bdbafaa58b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:20:33.448223 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=34,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:21:13.440727 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:21:24.791290 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] Flow 'volume_create_scheduler' (69e9740a-a506-4354-a986-6361b11a3763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:21:24.797998 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8468fb6d-f0fb-4ed9-a655-4783e9d5cca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:21:24.808110 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8468fb6d-f0fb-4ed9-a655-4783e9d5cca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(6e5f8c63-ec3f-4b9a-8b6b-e4c042782624),volume_id=6e5f8c63-ec3f-4b9a-8b6b-e4c042782624,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:21:24.815611 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (11ac083c-03a7-4009-a82e-6af615ab574e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:21:24.847465 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:21:24.872222 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:21:24.872618 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:21:24.872971 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:21:24.873484 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:21:24.873968 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:21:24.874478 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] Filtering removed all hosts for the request with volume ID '6e5f8c63-ec3f-4b9a-8b6b-e4c042782624'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:21:24.876262 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] Filtering removed all hosts for the request with volume ID '6e5f8c63-ec3f-4b9a-8b6b-e4c042782624'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:21:24.876944 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:21:24.877544 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] Creating message record for request_id = req-04662d1c-e638-416e-9405-a6d3d027c055 Aug 20 21:21:24.894360 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:21:24.894812 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] Setting Volume 6e5f8c63-ec3f-4b9a-8b6b-e4c042782624 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:21:24.912884 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (11ac083c-03a7-4009-a82e-6af615ab574e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:21:24.918679 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-04662d1c-e638-416e-9405-a6d3d027c055 tempest-AttachVolumeNegativeTest-209157223 None] Flow 'volume_create_scheduler' (69e9740a-a506-4354-a986-6361b11a3763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:21:26.874989 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-80309cff-1f4e-4876-91e8-1bcc9701320e None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:21:41.604881 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] Flow 'volume_create_scheduler' (5ad580e3-e400-4409-a476-4a615f75b813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:21:41.609092 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (66bbfd04-8611-40f1-9fdf-baeefe90effc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:21:41.613279 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (66bbfd04-8611-40f1-9fdf-baeefe90effc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(93b8d13e-9ed9-4bf6-996d-c1e0b3fdd7f4),volume_id=93b8d13e-9ed9-4bf6-996d-c1e0b3fdd7f4,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:21:41.617090 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (80ddce35-2f1f-45ca-8a49-702260af7b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:21:41.625506 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:21:41.643878 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:21:41.644631 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:21:41.645173 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:21:41.645776 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:21:41.646405 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:21:41.646986 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] Filtering removed all hosts for the request with volume ID '93b8d13e-9ed9-4bf6-996d-c1e0b3fdd7f4'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:21:41.647599 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] Filtering removed all hosts for the request with volume ID '93b8d13e-9ed9-4bf6-996d-c1e0b3fdd7f4'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:21:41.648570 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:21:41.649006 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] Creating message record for request_id = req-14598158-11e9-4c5a-892e-a219cd016bb7 Aug 20 21:21:41.656508 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:21:41.656886 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] Setting Volume 93b8d13e-9ed9-4bf6-996d-c1e0b3fdd7f4 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:21:41.672220 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (80ddce35-2f1f-45ca-8a49-702260af7b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:21:41.677538 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-14598158-11e9-4c5a-892e-a219cd016bb7 tempest-VolumesTestJSON-822654155 None] Flow 'volume_create_scheduler' (5ad580e3-e400-4409-a476-4a615f75b813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:21:53.451831 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=34,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:22:26.868907 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-7205e5be-eef3-41b2-a23f-94d6c89f834d None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:22:33.465970 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:23:01.525743 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] Flow 'volume_create_scheduler' (06f5571d-2a3f-4c43-ac71-e9da86a5483d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:23:01.540299 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (04dfad86-ca56-49f6-a24b-d22f906fbe77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:23:01.551302 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (04dfad86-ca56-49f6-a24b-d22f906fbe77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=cdbd7b72-a449-4911-a314-de189b7a9b1c,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c6383ec8-73b2-4a8d-a008-d7d7357444bc),volume_id=c6383ec8-73b2-4a8d-a008-d7d7357444bc,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:23:01.565564 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (dc011d42-6f3c-4ee1-958d-f0893498927d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:23:01.604067 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:23:01.642237 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:23:01.643682 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:23:01.645570 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:23:01.646168 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:23:01.646735 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:23:01.648126 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] Filtering removed all hosts for the request with volume ID 'c6383ec8-73b2-4a8d-a008-d7d7357444bc'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:23:01.648718 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] Filtering removed all hosts for the request with volume ID 'c6383ec8-73b2-4a8d-a008-d7d7357444bc'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:23:01.652223 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:23:01.653569 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] Creating message record for request_id = req-d5b91456-befc-4fab-abc3-f25865de431c Aug 20 21:23:01.672036 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:23:01.673693 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] Setting Volume c6383ec8-73b2-4a8d-a008-d7d7357444bc to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:23:01.699762 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (dc011d42-6f3c-4ee1-958d-f0893498927d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:23:01.705544 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d5b91456-befc-4fab-abc3-f25865de431c tempest-TaggedBootDevicesTest-429827312 None] Flow 'volume_create_scheduler' (06f5571d-2a3f-4c43-ac71-e9da86a5483d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:23:08.167229 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:23:08.425277 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] Flow 'volume_create_scheduler' (3ed4dcfe-b6ff-4084-9426-ce1bad587777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:23:08.429695 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f3d7eba5-e625-4122-99a9-14b4c1630fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:23:08.433929 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f3d7eba5-e625-4122-99a9-14b4c1630fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=cdbd7b72-a449-4911-a314-de189b7a9b1c,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(1ad2d1f4-6aa9-4901-bdac-f82e3468bc8e),volume_id=1ad2d1f4-6aa9-4901-bdac-f82e3468bc8e,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:23:08.437463 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (83b2f6bf-2989-441b-ac14-b47df0137d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:23:08.449350 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:23:08.479647 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:23:08.480331 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:23:08.480860 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:23:08.481411 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:23:08.481936 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:23:08.482432 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] Filtering removed all hosts for the request with volume ID '1ad2d1f4-6aa9-4901-bdac-f82e3468bc8e'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:23:08.482934 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] Filtering removed all hosts for the request with volume ID '1ad2d1f4-6aa9-4901-bdac-f82e3468bc8e'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:23:08.485695 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:23:08.486340 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] Creating message record for request_id = req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b Aug 20 21:23:08.504492 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:23:08.505168 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] Setting Volume 1ad2d1f4-6aa9-4901-bdac-f82e3468bc8e to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:23:08.524418 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (83b2f6bf-2989-441b-ac14-b47df0137d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:23:08.527599 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e2d5d98c-d2cc-405f-af7f-3f9aa2275f2b tempest-TaggedBootDevicesTest_v242-2117177303 None] Flow 'volume_create_scheduler' (3ed4dcfe-b6ff-4084-9426-ce1bad587777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:23:26.880307 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-d1f47008-b57d-4b51-b3ae-594c06147c71 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:23:43.466648 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:24:19.736893 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:24:19.793688 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] Flow 'volume_create_scheduler' (831c0d4f-5d69-4962-9246-ee6e246e5173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:24:19.801445 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0c767628-da1b-4190-88e5-181b261b2a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:24:19.806235 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0c767628-da1b-4190-88e5-181b261b2a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7f2042d3-98de-459f-a1ca-64eeab8a087d),volume_id=7f2042d3-98de-459f-a1ca-64eeab8a087d,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:24:19.809768 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a6bb51a8-a4c1-4cbf-8845-00f05360717d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:24:19.822422 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:24:19.840138 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:24:19.840756 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:24:19.841305 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:19.841974 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:19.842535 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:19.843273 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] Filtering removed all hosts for the request with volume ID '7f2042d3-98de-459f-a1ca-64eeab8a087d'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:24:19.843794 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] Filtering removed all hosts for the request with volume ID '7f2042d3-98de-459f-a1ca-64eeab8a087d'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:24:19.844579 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:24:19.845378 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] Creating message record for request_id = req-434e8975-93ce-43ef-b058-43647c20ea4d Aug 20 21:24:19.855703 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:24:19.856569 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] Setting Volume 7f2042d3-98de-459f-a1ca-64eeab8a087d to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:24:19.872088 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a6bb51a8-a4c1-4cbf-8845-00f05360717d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:24:19.878230 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-434e8975-93ce-43ef-b058-43647c20ea4d tempest-SnapshotsActionsTest-1874783146 None] Flow 'volume_create_scheduler' (831c0d4f-5d69-4962-9246-ee6e246e5173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:24:26.874094 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-9c4dc883-ae68-45c4-a931-25d1acd703b0 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:24:27.213061 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] Flow 'volume_create_scheduler' (2098d413-8b28-4a1f-a085-e1e7d505fc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:24:27.223896 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (611c4970-8dbd-49de-bdc3-c25ee0f41971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:24:27.245553 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (611c4970-8dbd-49de-bdc3-c25ee0f41971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9a238025-36bc-48bd-bb09-802c3a43d7e9),volume_id=9a238025-36bc-48bd-bb09-802c3a43d7e9,volume_properties=VolumeProperties,volume_type=VolumeType(6f90cbba-d601-4640-8ac5-8791a7448ffd))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:24:27.254850 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (35a60431-58fa-44f3-ab4b-80c74b6620ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:24:27.280860 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:24:27.304724 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:24:27.305518 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:24:27.306095 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:27.306598 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:27.307139 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:27.307649 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] Filtering removed all hosts for the request with volume ID '9a238025-36bc-48bd-bb09-802c3a43d7e9'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:24:27.308147 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] Filtering removed all hosts for the request with volume ID '9a238025-36bc-48bd-bb09-802c3a43d7e9'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:24:27.308824 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] No weighed backend found for volume with properties: {'id': '6f90cbba-d601-4640-8ac5-8791a7448ffd', 'name': 'tempest-UserMessagesTest-volume-type-897664087', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'storage_protocol': 'tempest-storage_protocol-474504725', 'vendor_name': 'tempest-vendor_name-1648160808'}, 'qos_specs_id': None, 'created_at': '2022-08-20T21:24:27.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:24:27.309429 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] Creating message record for request_id = req-cf921f02-c7de-464f-b6b3-0066dceea009 Aug 20 21:24:27.321978 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:24:27.324214 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] Setting Volume 9a238025-36bc-48bd-bb09-802c3a43d7e9 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:24:27.352797 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (35a60431-58fa-44f3-ab4b-80c74b6620ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:24:27.357694 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-cf921f02-c7de-464f-b6b3-0066dceea009 tempest-UserMessagesTest-921748563 None] Flow 'volume_create_scheduler' (2098d413-8b28-4a1f-a085-e1e7d505fc12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:24:28.881499 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] Flow 'volume_create_scheduler' (f9129ba6-c80e-4a04-8eb4-daacef38535c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:24:28.885941 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b09fccbc-d553-4c92-b883-1fa1d9db1bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:24:28.889999 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b09fccbc-d553-4c92-b883-1fa1d9db1bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5266fd78-83cb-4030-8327-6ee5560439a8),volume_id=5266fd78-83cb-4030-8327-6ee5560439a8,volume_properties=VolumeProperties,volume_type=VolumeType(c3f88e4c-2f76-430c-876f-07ab6947e71f))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:24:28.895355 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (aa5e1450-7ca6-495e-a06e-cc2810fbc84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:24:28.905116 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:24:28.930476 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:24:28.930953 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:24:28.931399 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:28.931838 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:28.932237 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:28.932735 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] Filtering removed all hosts for the request with volume ID '5266fd78-83cb-4030-8327-6ee5560439a8'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:24:28.933164 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] Filtering removed all hosts for the request with volume ID '5266fd78-83cb-4030-8327-6ee5560439a8'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:24:28.933712 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] No weighed backend found for volume with properties: {'id': 'c3f88e4c-2f76-430c-876f-07ab6947e71f', 'name': 'tempest-UserMessagesTest-volume-type-1533803456', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'storage_protocol': 'tempest-storage_protocol-1635253714', 'vendor_name': 'tempest-vendor_name-748561620'}, 'qos_specs_id': None, 'created_at': '2022-08-20T21:24:29.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:24:28.935098 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] Creating message record for request_id = req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 Aug 20 21:24:28.953062 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:24:28.954303 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] Setting Volume 5266fd78-83cb-4030-8327-6ee5560439a8 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:24:28.973439 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (aa5e1450-7ca6-495e-a06e-cc2810fbc84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:24:28.976546 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-398537b5-ce5b-4d63-ae1f-94c6c4f284a5 tempest-UserMessagesTest-921748563 None] Flow 'volume_create_scheduler' (f9129ba6-c80e-4a04-8eb4-daacef38535c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:24:37.574846 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] Flow 'volume_create_scheduler' (3d1b16bc-fef4-4791-9456-b09383586a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:24:37.581563 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (27222a5b-7111-4647-a509-d01ca26f507a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:24:37.593809 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (27222a5b-7111-4647-a509-d01ca26f507a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(6a339baa-d2ad-43d1-aecb-ad124d347c5b),volume_id=6a339baa-d2ad-43d1-aecb-ad124d347c5b,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:24:37.600595 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cefeb9ce-21e5-4e03-b250-f7a780f99853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:24:37.624066 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:24:37.651480 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:24:37.651836 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:24:37.652189 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:37.652566 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:37.652908 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:37.653330 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] Filtering removed all hosts for the request with volume ID '6a339baa-d2ad-43d1-aecb-ad124d347c5b'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:24:37.653579 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] Filtering removed all hosts for the request with volume ID '6a339baa-d2ad-43d1-aecb-ad124d347c5b'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:24:37.659041 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:24:37.659466 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] Creating message record for request_id = req-404c4be8-5ff4-4dbe-9526-bc9c12339033 Aug 20 21:24:37.670670 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:24:37.671310 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] Setting Volume 6a339baa-d2ad-43d1-aecb-ad124d347c5b to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:24:37.693088 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cefeb9ce-21e5-4e03-b250-f7a780f99853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:24:37.696292 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-404c4be8-5ff4-4dbe-9526-bc9c12339033 tempest-VolumeQuotasAdminTestJSON-653267125 None] Flow 'volume_create_scheduler' (3d1b16bc-fef4-4791-9456-b09383586a39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:24:39.278403 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] Flow 'volume_create_scheduler' (da5b4722-b14f-4447-871b-3f417c9d42d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:24:39.295427 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (02461e05-61ae-4147-b391-6f41789a92cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:24:39.300207 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (02461e05-61ae-4147-b391-6f41789a92cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5b83ded7-0d35-461c-a54b-0004157c08cc),volume_id=5b83ded7-0d35-461c-a54b-0004157c08cc,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:24:39.303781 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (79172d54-9af1-48d4-9792-c5a9111cece8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:24:39.353180 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:24:39.401974 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:24:39.404922 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:24:39.405457 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:39.410543 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:39.411260 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:39.411911 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] Filtering removed all hosts for the request with volume ID '5b83ded7-0d35-461c-a54b-0004157c08cc'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:24:39.412547 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] Filtering removed all hosts for the request with volume ID '5b83ded7-0d35-461c-a54b-0004157c08cc'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:24:39.413532 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:24:39.414186 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] Creating message record for request_id = req-3e8e4b67-8318-4177-abc9-d8862b38d138 Aug 20 21:24:39.432044 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:24:39.433163 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] Setting Volume 5b83ded7-0d35-461c-a54b-0004157c08cc to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:24:39.456217 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (79172d54-9af1-48d4-9792-c5a9111cece8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:24:39.468460 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-3e8e4b67-8318-4177-abc9-d8862b38d138 tempest-VolumeQuotasAdminTestJSON-653267125 None] Flow 'volume_create_scheduler' (da5b4722-b14f-4447-871b-3f417c9d42d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:24:50.278300 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=64,cinder:UPDATE=13,cinder:INSERT=5,cinder:DELETE=5 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:24:50.339626 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] Flow 'volume_create_scheduler' (dff97fe5-9f7a-47f2-840c-18320eac21da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:24:50.353184 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4e2f42cc-2db1-43d0-a110-883516d35253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:24:50.362884 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4e2f42cc-2db1-43d0-a110-883516d35253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8f781b1f-f666-43a7-8dca-e7cd66de932e),volume_id=8f781b1f-f666-43a7-8dca-e7cd66de932e,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:24:50.401289 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4636fc6a-ace9-482e-b246-eafa08d7e270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:24:50.413374 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:24:50.433308 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:24:50.434230 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:24:50.434594 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:50.435134 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:50.435483 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:24:50.435831 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] Filtering removed all hosts for the request with volume ID '8f781b1f-f666-43a7-8dca-e7cd66de932e'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:24:50.436411 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] Filtering removed all hosts for the request with volume ID '8f781b1f-f666-43a7-8dca-e7cd66de932e'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:24:50.437061 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:24:50.437650 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] Creating message record for request_id = req-39792304-5b27-469c-810b-bd5c3735a88f Aug 20 21:24:50.446902 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:24:50.447650 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] Setting Volume 8f781b1f-f666-43a7-8dca-e7cd66de932e to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:24:50.464862 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4636fc6a-ace9-482e-b246-eafa08d7e270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:24:50.470682 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-39792304-5b27-469c-810b-bd5c3735a88f tempest-VolumeSnapshotQuotasNegativeTestJSON-531046287 None] Flow 'volume_create_scheduler' (dff97fe5-9f7a-47f2-840c-18320eac21da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:02.573603 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] Flow 'volume_create_scheduler' (52c58404-e03c-4880-b6ab-bd8362bb3181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:02.577974 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6d369e74-4838-47b9-ab53-3a78856e233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:02.590996 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6d369e74-4838-47b9-ab53-3a78856e233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8b6da33b-d93f-444e-a94e-b47ab171843f),volume_id=8b6da33b-d93f-444e-a94e-b47ab171843f,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:02.595225 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e2d4fc62-c28e-4ab4-89cd-e325a8b46bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:02.609966 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:25:02.625412 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:25:02.625836 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:25:02.626208 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:02.626606 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:02.626930 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:02.627442 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] Filtering removed all hosts for the request with volume ID '8b6da33b-d93f-444e-a94e-b47ab171843f'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:25:02.627936 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] Filtering removed all hosts for the request with volume ID '8b6da33b-d93f-444e-a94e-b47ab171843f'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:25:02.628592 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:25:02.629462 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] Creating message record for request_id = req-0afaf213-d9ce-47df-a796-391b33aa9782 Aug 20 21:25:02.639936 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:25:02.641542 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] Setting Volume 8b6da33b-d93f-444e-a94e-b47ab171843f to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:25:02.659450 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e2d4fc62-c28e-4ab4-89cd-e325a8b46bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:02.666234 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0afaf213-d9ce-47df-a796-391b33aa9782 tempest-VolumesMetadataTest-938056386 None] Flow 'volume_create_scheduler' (52c58404-e03c-4880-b6ab-bd8362bb3181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:08.016546 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] Flow 'volume_create_scheduler' (7927384c-cba9-4d65-80a9-f9dc53581adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:08.022869 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ecbb928b-6372-4e26-af60-214b74dd3289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:08.027495 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ecbb928b-6372-4e26-af60-214b74dd3289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9b4b17a6-bad9-456e-9d1f-b9f4f2008739),volume_id=9b4b17a6-bad9-456e-9d1f-b9f4f2008739,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:08.030894 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ca3d9af8-9b70-4c4a-ac0e-106d36dff4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:08.039778 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:25:08.053951 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:25:08.054389 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:25:08.054861 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:08.055408 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:08.055753 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:08.056099 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] Filtering removed all hosts for the request with volume ID '9b4b17a6-bad9-456e-9d1f-b9f4f2008739'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:25:08.056477 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] Filtering removed all hosts for the request with volume ID '9b4b17a6-bad9-456e-9d1f-b9f4f2008739'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:25:08.056965 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:25:08.057403 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] Creating message record for request_id = req-a3e1a734-d996-4d43-9144-9a734e302941 Aug 20 21:25:08.064787 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:25:08.065186 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] Setting Volume 9b4b17a6-bad9-456e-9d1f-b9f4f2008739 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:25:08.079445 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ca3d9af8-9b70-4c4a-ac0e-106d36dff4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:08.083242 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a3e1a734-d996-4d43-9144-9a734e302941 tempest-VolumesTransfersV355Test-61041382 None] Flow 'volume_create_scheduler' (7927384c-cba9-4d65-80a9-f9dc53581adf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:09.420700 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] Flow 'volume_create_scheduler' (b5cf8b6c-4abc-422a-9555-0ada7fd3a152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:09.426566 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6d304970-a59c-4a0d-9e2c-58bfb7e7d838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:09.431965 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6d304970-a59c-4a0d-9e2c-58bfb7e7d838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7354074c-7642-44d4-bbb8-76e3be6971e7),volume_id=7354074c-7642-44d4-bbb8-76e3be6971e7,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:09.437377 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (91ead300-d36f-4b34-aaac-c4a33cb8652e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:09.449065 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:25:09.464989 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:25:09.465637 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:25:09.466156 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:09.466777 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:09.467090 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:09.467470 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] Filtering removed all hosts for the request with volume ID '7354074c-7642-44d4-bbb8-76e3be6971e7'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:25:09.468191 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] Filtering removed all hosts for the request with volume ID '7354074c-7642-44d4-bbb8-76e3be6971e7'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:25:09.469099 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:25:09.469696 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] Creating message record for request_id = req-5617d3ff-453d-41b5-a921-35f4b2798a64 Aug 20 21:25:09.478517 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:25:09.479492 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] Setting Volume 7354074c-7642-44d4-bbb8-76e3be6971e7 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:25:09.490619 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (91ead300-d36f-4b34-aaac-c4a33cb8652e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:09.494484 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-5617d3ff-453d-41b5-a921-35f4b2798a64 tempest-VolumesTransfersV355Test-61041382 None] Flow 'volume_create_scheduler' (b5cf8b6c-4abc-422a-9555-0ada7fd3a152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:20.052841 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] Flow 'volume_create_scheduler' (48cfc336-c2e8-4179-a0db-5313123c5c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:20.058521 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0b7e5077-e23e-4804-82c9-04ebfbcf5234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:20.063789 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0b7e5077-e23e-4804-82c9-04ebfbcf5234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(743012dd-abff-4b2b-921f-488690edb21e),volume_id=743012dd-abff-4b2b-921f-488690edb21e,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:20.068681 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e672f705-2eec-44eb-890a-9c2c71bf6fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:20.077937 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:25:20.100307 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:25:20.100746 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:25:20.101573 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:20.102019 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:20.102408 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:20.102902 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] Filtering removed all hosts for the request with volume ID '743012dd-abff-4b2b-921f-488690edb21e'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:25:20.103315 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] Filtering removed all hosts for the request with volume ID '743012dd-abff-4b2b-921f-488690edb21e'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:25:20.103874 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:25:20.104365 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] Creating message record for request_id = req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 Aug 20 21:25:20.112646 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:25:20.113267 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] Setting Volume 743012dd-abff-4b2b-921f-488690edb21e to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:25:20.129041 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e672f705-2eec-44eb-890a-9c2c71bf6fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:20.133054 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-4532ac8b-3f9f-45cc-ab87-3496a9053b63 tempest-VolumesSnapshotTestJSON-507759543 None] Flow 'volume_create_scheduler' (48cfc336-c2e8-4179-a0db-5313123c5c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:23.473307 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=64,cinder:UPDATE=13,cinder:INSERT=5,cinder:DELETE=5 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:25:26.872482 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-04d24462-5a02-499d-a93f-c265d6cd01f5 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:25:41.761141 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-ecd525e6-5fa7-4f56-a484-64dedb03e50d tempest-BackendsCapabilitiesAdminTestsJSON-1840225757 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:25:41.801657 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-06745b24-bb52-4b02-b6cd-9f79c8200ef4 tempest-BackendsCapabilitiesAdminTestsJSON-1840225757 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:25:46.261024 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-392430d2-b5e4-442c-96ba-0b832e8dbbe0 tempest-GroupsTest-1915450743 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:25:46.297282 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-392430d2-b5e4-442c-96ba-0b832e8dbbe0 tempest-GroupsTest-1915450743 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:25:46.300669 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.manager [None req-392430d2-b5e4-442c-96ba-0b832e8dbbe0 tempest-GroupsTest-1915450743 None] Could not find a backend for group 907cbbac-da03-4d50-8f2c-6aac3d4bf71f.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:25:48.156633 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-3c913f8b-2c73-49a5-b9b1-9021357a2ed4 tempest-GroupsTest-1915450743 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:25:48.195345 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-3c913f8b-2c73-49a5-b9b1-9021357a2ed4 tempest-GroupsTest-1915450743 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:25:48.196551 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.manager [None req-3c913f8b-2c73-49a5-b9b1-9021357a2ed4 tempest-GroupsTest-1915450743 None] Could not find a backend for group 8ef1dd93-ed1c-47fd-bd59-d5660b9cefc9.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:25:53.796635 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=26,cinder:UPDATE=6 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:25:53.857443 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] Flow 'volume_create_scheduler' (b6ed8e3d-12bd-4660-bc50-0310c6d1a156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:53.862200 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fedcbe7f-9db3-42bb-bb8b-df23193fccc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:53.866074 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fedcbe7f-9db3-42bb-bb8b-df23193fccc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(046efb49-f55b-4aba-abe1-7a577cdb5ca1),volume_id=046efb49-f55b-4aba-abe1-7a577cdb5ca1,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:53.879761 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fd57e3c1-99c0-42b3-a967-31059e9641ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:53.899317 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:25:53.928442 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:25:53.928795 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:25:53.929147 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:53.929495 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:53.929830 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:53.930341 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] Filtering removed all hosts for the request with volume ID '046efb49-f55b-4aba-abe1-7a577cdb5ca1'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:25:53.930835 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] Filtering removed all hosts for the request with volume ID '046efb49-f55b-4aba-abe1-7a577cdb5ca1'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:25:53.931487 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:25:53.932072 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] Creating message record for request_id = req-a3616082-854e-417b-a999-793400020091 Aug 20 21:25:53.940695 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:25:53.941572 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] Setting Volume 046efb49-f55b-4aba-abe1-7a577cdb5ca1 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:25:53.956679 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fd57e3c1-99c0-42b3-a967-31059e9641ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:53.960824 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-a3616082-854e-417b-a999-793400020091 tempest-VolumesCloneNegativeTest-739577143 None] Flow 'volume_create_scheduler' (b6ed8e3d-12bd-4660-bc50-0310c6d1a156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:54.290854 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] Flow 'volume_create_scheduler' (f6e74463-ceae-4d4c-a0aa-a57a1d0cb535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:54.298202 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8eba522f-5aac-45c2-a958-8eaf17e8955d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:54.302378 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8eba522f-5aac-45c2-a958-8eaf17e8955d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=cdbd7b72-a449-4911-a314-de189b7a9b1c,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bcc991b6-3b16-44c0-af65-5e22c3d4c300),volume_id=bcc991b6-3b16-44c0-af65-5e22c3d4c300,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:54.306073 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f8f47153-b888-485d-888f-da5921681cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:54.314765 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:25:54.330928 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:25:54.331308 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:25:54.331760 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:54.332276 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:54.332647 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:54.332990 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] Filtering removed all hosts for the request with volume ID 'bcc991b6-3b16-44c0-af65-5e22c3d4c300'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:25:54.333331 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] Filtering removed all hosts for the request with volume ID 'bcc991b6-3b16-44c0-af65-5e22c3d4c300'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:25:54.333877 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:25:54.334295 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] Creating message record for request_id = req-d07af375-2d71-496c-a02b-52df8c4ec93c Aug 20 21:25:54.341913 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:25:54.342392 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] Setting Volume bcc991b6-3b16-44c0-af65-5e22c3d4c300 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:25:54.353076 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f8f47153-b888-485d-888f-da5921681cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:54.356246 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d07af375-2d71-496c-a02b-52df8c4ec93c tempest-TestVolumeBackupRestore-1754002025 None] Flow 'volume_create_scheduler' (f6e74463-ceae-4d4c-a0aa-a57a1d0cb535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:57.612174 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] Flow 'volume_create_scheduler' (2988da10-1ad0-42bd-afed-7b98f2eb3202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:57.616851 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5ba5a8ab-ff49-401b-b0ee-fb43b0a5f8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:57.622833 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5ba5a8ab-ff49-401b-b0ee-fb43b0a5f8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=cdbd7b72-a449-4911-a314-de189b7a9b1c,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2d177f54-b5ef-4711-aa3d-093df0b11ebc),volume_id=2d177f54-b5ef-4711-aa3d-093df0b11ebc,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:57.628041 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (98be7996-f7d5-49d9-a37b-82be50d845ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:57.647432 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:25:57.665664 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:25:57.666026 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:25:57.666378 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:57.666724 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:57.667065 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:57.667410 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] Filtering removed all hosts for the request with volume ID '2d177f54-b5ef-4711-aa3d-093df0b11ebc'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:25:57.667749 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] Filtering removed all hosts for the request with volume ID '2d177f54-b5ef-4711-aa3d-093df0b11ebc'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:25:57.668235 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:25:57.668940 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] Creating message record for request_id = req-260b56f2-401d-4471-9133-70b8e1b43f4e Aug 20 21:25:57.682090 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:25:57.682722 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] Setting Volume 2d177f54-b5ef-4711-aa3d-093df0b11ebc to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:25:57.710335 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (98be7996-f7d5-49d9-a37b-82be50d845ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:57.715165 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-260b56f2-401d-4471-9133-70b8e1b43f4e tempest-VolumesExtendTest-495378582 None] Flow 'volume_create_scheduler' (2988da10-1ad0-42bd-afed-7b98f2eb3202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:59.097750 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] Flow 'volume_create_scheduler' (cc10db72-1a31-4b8c-9556-3c7a08ee6224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:25:59.103377 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ea337607-aa4a-47d1-b8b9-638a46a44ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:59.108685 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ea337607-aa4a-47d1-b8b9-638a46a44ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(02970abd-430d-4a54-b9a7-26aaad247ea2),volume_id=02970abd-430d-4a54-b9a7-26aaad247ea2,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:59.114472 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (046109d3-fe79-4844-8622-773e593691bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:25:59.123946 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:25:59.139211 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:25:59.139878 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:25:59.140555 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:59.141359 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:59.141718 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:25:59.142281 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] Filtering removed all hosts for the request with volume ID '02970abd-430d-4a54-b9a7-26aaad247ea2'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:25:59.142762 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] Filtering removed all hosts for the request with volume ID '02970abd-430d-4a54-b9a7-26aaad247ea2'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:25:59.143354 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:25:59.143910 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] Creating message record for request_id = req-23270d17-80d0-4228-9f70-a45300ec5d7d Aug 20 21:25:59.152299 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:25:59.152860 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] Setting Volume 02970abd-430d-4a54-b9a7-26aaad247ea2 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:25:59.168841 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (046109d3-fe79-4844-8622-773e593691bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:25:59.173090 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-23270d17-80d0-4228-9f70-a45300ec5d7d tempest-VolumesExtendTest-495378582 None] Flow 'volume_create_scheduler' (cc10db72-1a31-4b8c-9556-3c7a08ee6224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:26:26.881249 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-d85e18b7-ca60-4cf7-b408-25aa285a315e None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:26:33.473014 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=53,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:26:37.767005 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] Flow 'volume_create_scheduler' (ec47a32a-8765-4d3c-8a53-3a4c63b77975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:26:37.771170 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0319baaf-b515-486d-9eaf-13392e4293ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:26:37.775179 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0319baaf-b515-486d-9eaf-13392e4293ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(3a8acaaa-c39a-4f4a-b6e1-d340afa9c3c4),volume_id=3a8acaaa-c39a-4f4a-b6e1-d340afa9c3c4,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:26:37.778525 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3c11e023-bfa0-410d-9b8c-8ce77f27bfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:26:37.787892 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:26:37.802602 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:26:37.803023 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:26:37.803380 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:26:37.803731 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:26:37.804076 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:26:37.804447 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] Filtering removed all hosts for the request with volume ID '3a8acaaa-c39a-4f4a-b6e1-d340afa9c3c4'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:26:37.804793 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] Filtering removed all hosts for the request with volume ID '3a8acaaa-c39a-4f4a-b6e1-d340afa9c3c4'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:26:37.805349 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:26:37.805703 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] Creating message record for request_id = req-57848f38-14ef-43c4-8912-ab27f2d692a7 Aug 20 21:26:37.813446 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:26:37.813851 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] Setting Volume 3a8acaaa-c39a-4f4a-b6e1-d340afa9c3c4 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:26:37.824720 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3c11e023-bfa0-410d-9b8c-8ce77f27bfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:26:37.828726 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-57848f38-14ef-43c4-8912-ab27f2d692a7 tempest-ServersNegativeTestJSON-1719275156 None] Flow 'volume_create_scheduler' (ec47a32a-8765-4d3c-8a53-3a4c63b77975) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:26:39.479230 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] Flow 'volume_create_scheduler' (bbb26528-5a5e-4a25-9377-80944b687513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:26:39.484597 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d79327a9-d34b-4da9-882e-abef7bd72c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:26:39.488529 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d79327a9-d34b-4da9-882e-abef7bd72c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f2369abf-35f9-4bb9-baa1-9b2932f13ea8),volume_id=f2369abf-35f9-4bb9-baa1-9b2932f13ea8,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:26:39.491940 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9ac986f9-9215-46bf-b213-04bfd572c9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:26:39.508138 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:26:39.514609 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:26:39.515335 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:26:39.515335 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:26:39.515714 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:26:39.516101 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:26:39.516479 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] Filtering removed all hosts for the request with volume ID 'f2369abf-35f9-4bb9-baa1-9b2932f13ea8'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:26:39.516997 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] Filtering removed all hosts for the request with volume ID 'f2369abf-35f9-4bb9-baa1-9b2932f13ea8'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:26:39.517623 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:26:39.518820 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] Creating message record for request_id = req-2df0b41a-be20-403c-be7b-8b69fde61d4b Aug 20 21:26:39.526667 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:26:39.527069 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] Setting Volume f2369abf-35f9-4bb9-baa1-9b2932f13ea8 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:26:39.537831 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9ac986f9-9215-46bf-b213-04bfd572c9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:26:39.541090 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-2df0b41a-be20-403c-be7b-8b69fde61d4b tempest-ServersNegativeTestJSON-1719275156 None] Flow 'volume_create_scheduler' (bbb26528-5a5e-4a25-9377-80944b687513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:27:13.487828 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=34,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:27:26.881965 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-2c084deb-c826-48f9-9247-f49b43e5b1dc None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:27:43.335456 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] Flow 'volume_create_scheduler' (329b200e-bc23-4f11-a58b-ef6486a59ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:27:43.339654 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1a3198a7-3e79-4f3d-8da1-86680984382b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:27:43.343472 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1a3198a7-3e79-4f3d-8da1-86680984382b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ac2c35c5-d41c-4e40-89b7-aa2b4df95aa3),volume_id=ac2c35c5-d41c-4e40-89b7-aa2b4df95aa3,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:27:43.346862 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3a806b93-27c5-4944-b47e-4d1d0090233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:27:43.356828 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:27:43.370567 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:27:43.370932 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:27:43.371290 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:43.371640 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:43.371989 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:43.372341 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] Filtering removed all hosts for the request with volume ID 'ac2c35c5-d41c-4e40-89b7-aa2b4df95aa3'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:27:43.372717 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] Filtering removed all hosts for the request with volume ID 'ac2c35c5-d41c-4e40-89b7-aa2b4df95aa3'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:27:43.373198 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:27:43.373624 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] Creating message record for request_id = req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 Aug 20 21:27:43.381663 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:27:43.381980 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] Setting Volume ac2c35c5-d41c-4e40-89b7-aa2b4df95aa3 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:27:43.392729 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3a806b93-27c5-4944-b47e-4d1d0090233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:27:43.396058 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7847ab3e-9d4f-4beb-add2-78cc7731aab5 tempest-VolumesActionsTest-1857985160 None] Flow 'volume_create_scheduler' (329b200e-bc23-4f11-a58b-ef6486a59ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:27:48.462046 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:27:48.491179 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] Flow 'volume_create_scheduler' (0b07aeb3-0723-4952-ae02-c61083d5f630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:27:48.495548 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f4b3ffaa-4f6c-45f3-92f2-7ce5a9f2f686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:27:48.499691 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f4b3ffaa-4f6c-45f3-92f2-7ce5a9f2f686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7db70b83-ffdd-42fc-9e52-558c7ce61e98),volume_id=7db70b83-ffdd-42fc-9e52-558c7ce61e98,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:27:48.502950 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a3e23e4a-d76d-414f-9bfb-307b09e79b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:27:48.511731 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:27:48.526591 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:27:48.526949 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:27:48.527325 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:48.527673 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:48.528013 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:48.528353 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] Filtering removed all hosts for the request with volume ID '7db70b83-ffdd-42fc-9e52-558c7ce61e98'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:27:48.528711 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] Filtering removed all hosts for the request with volume ID '7db70b83-ffdd-42fc-9e52-558c7ce61e98'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:27:48.529186 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:27:48.529599 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] Creating message record for request_id = req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 Aug 20 21:27:48.536933 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:27:48.537296 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] Setting Volume 7db70b83-ffdd-42fc-9e52-558c7ce61e98 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:27:48.552555 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a3e23e4a-d76d-414f-9bfb-307b09e79b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:27:48.558349 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7a974e54-6e41-4e56-b6ad-e7b9c86c9083 tempest-VolumesActionsTest-1857985160 None] Flow 'volume_create_scheduler' (0b07aeb3-0723-4952-ae02-c61083d5f630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:27:49.843687 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] Flow 'volume_create_scheduler' (d3e51c4e-21c2-416b-a45f-5c38aafb47d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:27:49.848657 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c205ed0f-9073-470f-9505-e0ac20d17c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:27:49.852819 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c205ed0f-9073-470f-9505-e0ac20d17c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(61f8ae0a-5694-453b-874b-f1a2b4abf028),volume_id=61f8ae0a-5694-453b-874b-f1a2b4abf028,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:27:49.856206 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (36d8d1c4-1ca0-4933-969a-99c47caa8b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:27:49.864502 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:27:49.878369 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:27:49.878736 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:27:49.879089 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:49.879435 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:49.879779 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:49.880123 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] Filtering removed all hosts for the request with volume ID '61f8ae0a-5694-453b-874b-f1a2b4abf028'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:27:49.880490 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] Filtering removed all hosts for the request with volume ID '61f8ae0a-5694-453b-874b-f1a2b4abf028'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:27:49.881040 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:27:49.881463 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] Creating message record for request_id = req-fbdcf914-34a7-49f1-9f48-5e391f4f658a Aug 20 21:27:49.893055 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:27:49.893554 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] Setting Volume 61f8ae0a-5694-453b-874b-f1a2b4abf028 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:27:49.905010 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (36d8d1c4-1ca0-4933-969a-99c47caa8b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:27:49.908149 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-fbdcf914-34a7-49f1-9f48-5e391f4f658a tempest-VolumesActionsTest-1857985160 None] Flow 'volume_create_scheduler' (d3e51c4e-21c2-416b-a45f-5c38aafb47d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:27:51.207637 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] Flow 'volume_create_scheduler' (2892588e-ebe8-4d98-a0a5-51062b855160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:27:51.214495 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (84429046-0348-4b17-b0ff-210be0f81ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:27:51.228399 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (84429046-0348-4b17-b0ff-210be0f81ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(865afb7e-6d3b-45a7-a323-36d554f8cfec),volume_id=865afb7e-6d3b-45a7-a323-36d554f8cfec,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:27:51.228399 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (92c4af69-b17e-403d-973c-5a1646bc2c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:27:51.230695 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:27:51.245836 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:27:51.246157 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:27:51.246509 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:51.246849 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:51.247184 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:51.247526 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] Filtering removed all hosts for the request with volume ID '865afb7e-6d3b-45a7-a323-36d554f8cfec'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:27:51.247864 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] Filtering removed all hosts for the request with volume ID '865afb7e-6d3b-45a7-a323-36d554f8cfec'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:27:51.248336 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:27:51.248778 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] Creating message record for request_id = req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 Aug 20 21:27:51.256621 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:27:51.257002 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] Setting Volume 865afb7e-6d3b-45a7-a323-36d554f8cfec to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:27:51.267444 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (92c4af69-b17e-403d-973c-5a1646bc2c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:27:51.270692 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-d3bfcc94-87f4-4ebc-90f3-9f187cd83c57 tempest-VolumesActionsTest-1857985160 None] Flow 'volume_create_scheduler' (2892588e-ebe8-4d98-a0a5-51062b855160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:27:52.588443 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] Flow 'volume_create_scheduler' (bdf56cd9-987e-487d-a533-c5818c3d257d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:27:52.599112 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e5fcc3e6-eaa4-4389-bf7b-bd427b43e4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:27:52.599247 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e5fcc3e6-eaa4-4389-bf7b-bd427b43e4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a131d3b4-256a-4140-b9c0-85e5441e0222),volume_id=a131d3b4-256a-4140-b9c0-85e5441e0222,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:27:52.607208 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2a6345f9-c5dc-4f3f-a9e0-89a04ffed4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:27:52.620420 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:27:52.630955 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:27:52.631431 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:27:52.631850 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:52.632269 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:52.632712 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:52.633125 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] Filtering removed all hosts for the request with volume ID 'a131d3b4-256a-4140-b9c0-85e5441e0222'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:27:52.633535 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] Filtering removed all hosts for the request with volume ID 'a131d3b4-256a-4140-b9c0-85e5441e0222'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:27:52.634026 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:27:52.634456 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] Creating message record for request_id = req-49b3778f-e415-489e-8625-b17e07b982e9 Aug 20 21:27:52.642019 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:27:52.642632 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] Setting Volume a131d3b4-256a-4140-b9c0-85e5441e0222 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:27:52.653680 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2a6345f9-c5dc-4f3f-a9e0-89a04ffed4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:27:52.656754 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-49b3778f-e415-489e-8625-b17e07b982e9 tempest-VolumesActionsTest-1857985160 None] Flow 'volume_create_scheduler' (bdf56cd9-987e-487d-a533-c5818c3d257d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:27:53.926477 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] Flow 'volume_create_scheduler' (0af4f6f5-6311-46c4-be5b-56deeaac02eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:27:53.930502 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (50a88887-307a-41ee-bc6c-b185ad7be49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:27:53.934309 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (50a88887-307a-41ee-bc6c-b185ad7be49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(1ff95944-e3b1-4afc-8d3d-4931a5ea8a99),volume_id=1ff95944-e3b1-4afc-8d3d-4931a5ea8a99,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:27:53.937659 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (78372019-8af6-44e9-9043-1dd4b8f1d6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:27:53.946696 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:27:53.961585 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:27:53.961962 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:27:53.962315 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:53.962663 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:53.963000 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:27:53.963547 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] Filtering removed all hosts for the request with volume ID '1ff95944-e3b1-4afc-8d3d-4931a5ea8a99'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:27:53.963895 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] Filtering removed all hosts for the request with volume ID '1ff95944-e3b1-4afc-8d3d-4931a5ea8a99'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:27:53.964395 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:27:53.964814 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] Creating message record for request_id = req-e10fbf55-a5e4-4fda-9955-2b9c23563442 Aug 20 21:27:53.972186 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:27:53.972582 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] Setting Volume 1ff95944-e3b1-4afc-8d3d-4931a5ea8a99 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:27:53.983880 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (78372019-8af6-44e9-9043-1dd4b8f1d6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:27:53.986992 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e10fbf55-a5e4-4fda-9955-2b9c23563442 tempest-VolumesActionsTest-1857985160 None] Flow 'volume_create_scheduler' (0af4f6f5-6311-46c4-be5b-56deeaac02eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:28:01.066006 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] Flow 'volume_create_scheduler' (f0ba7bda-3d39-469e-8469-3e7b23b34c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:28:01.070405 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4e25d69a-1b8d-4dd0-9283-6b38f869320d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:28:01.074325 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4e25d69a-1b8d-4dd0-9283-6b38f869320d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(cd8acb1c-10c5-4176-b929-28488d81e444),volume_id=cd8acb1c-10c5-4176-b929-28488d81e444,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:28:01.077645 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (907480a6-0237-42da-a760-2ff4051cc50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:28:01.085769 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:28:01.100317 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:28:01.100666 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:28:01.100988 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:01.101331 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:01.101664 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:01.102003 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] Filtering removed all hosts for the request with volume ID 'cd8acb1c-10c5-4176-b929-28488d81e444'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:28:01.102335 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] Filtering removed all hosts for the request with volume ID 'cd8acb1c-10c5-4176-b929-28488d81e444'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:28:01.102795 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:28:01.103404 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] Creating message record for request_id = req-7ebbd3fc-6839-41fb-b795-aa646118700c Aug 20 21:28:01.111732 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:28:01.112145 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] Setting Volume cd8acb1c-10c5-4176-b929-28488d81e444 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:28:01.123536 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (907480a6-0237-42da-a760-2ff4051cc50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:28:01.126762 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7ebbd3fc-6839-41fb-b795-aa646118700c tempest-VolumesBackupsV39Test-1392534101 None] Flow 'volume_create_scheduler' (f0ba7bda-3d39-469e-8469-3e7b23b34c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:28:13.503099 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=74,cinder:UPDATE=14,cinder:INSERT=6,cinder:DELETE=6 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:28:26.880129 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-2dd6642f-e870-461d-a5bd-256708d3b9bf None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:28:36.254928 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] Flow 'volume_create_scheduler' (967e40e8-22bb-4e7c-a097-6fb8fdef0d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:28:36.259306 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6fd671f0-be79-44a3-a20b-37fece06d05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:28:36.263105 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6fd671f0-be79-44a3-a20b-37fece06d05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5250dcd0-992b-476f-9396-5ca10372e2fe),volume_id=5250dcd0-992b-476f-9396-5ca10372e2fe,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:28:36.266433 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d2f98f19-34ff-4812-826f-a32a2839057e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:28:36.274971 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:28:36.290874 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:28:36.291236 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:28:36.291613 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:36.292239 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:36.292714 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:36.293061 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] Filtering removed all hosts for the request with volume ID '5250dcd0-992b-476f-9396-5ca10372e2fe'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:28:36.293400 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] Filtering removed all hosts for the request with volume ID '5250dcd0-992b-476f-9396-5ca10372e2fe'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:28:36.293865 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:28:36.294287 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] Creating message record for request_id = req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 Aug 20 21:28:36.302240 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:28:36.302653 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] Setting Volume 5250dcd0-992b-476f-9396-5ca10372e2fe to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:28:36.315869 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d2f98f19-34ff-4812-826f-a32a2839057e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:28:36.320608 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-13a93c0b-8706-4a1d-b3ce-fd03a1abc3e7 tempest-VolumesListAdminTestJSON-579017916 None] Flow 'volume_create_scheduler' (967e40e8-22bb-4e7c-a097-6fb8fdef0d77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:28:42.902368 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] Flow 'volume_create_scheduler' (5c969eed-3bed-4596-819f-4cbabeded006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:28:42.907068 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (242b61db-8646-409c-ac2a-2fff523598a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:28:42.911410 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (242b61db-8646-409c-ac2a-2fff523598a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(3a0e8470-dc4f-47df-bda4-27d131d8ef07),volume_id=3a0e8470-dc4f-47df-bda4-27d131d8ef07,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:28:42.915012 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d0977f09-1cf2-4394-8a36-05fdb813c633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:28:42.923342 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:28:42.937854 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:28:42.938217 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:28:42.938747 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:42.939281 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:42.939922 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:42.940109 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] Filtering removed all hosts for the request with volume ID '3a0e8470-dc4f-47df-bda4-27d131d8ef07'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:28:42.940813 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] Filtering removed all hosts for the request with volume ID '3a0e8470-dc4f-47df-bda4-27d131d8ef07'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:28:42.940949 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:28:42.941387 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] Creating message record for request_id = req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 Aug 20 21:28:42.949066 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:28:42.949448 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] Setting Volume 3a0e8470-dc4f-47df-bda4-27d131d8ef07 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:28:42.961477 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d0977f09-1cf2-4394-8a36-05fdb813c633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:28:42.964654 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-0658cb5a-fb39-44b8-9b6c-ecf53fe22ad1 tempest-VolumesTransfersTest-1235742183 None] Flow 'volume_create_scheduler' (5c969eed-3bed-4596-819f-4cbabeded006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:28:44.243448 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=8,cinder:SELECT=32,cinder:INSERT=2,cinder:DELETE=2 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:28:44.271556 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] Flow 'volume_create_scheduler' (06e27cdb-114d-4f49-9903-a60c47435ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:28:44.276751 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (77814ce3-845b-4fa7-a973-c15f657c0ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:28:44.281793 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (77814ce3-845b-4fa7-a973-c15f657c0ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a012a7a9-bf44-4c35-a89f-1c63be8f59a6),volume_id=a012a7a9-bf44-4c35-a89f-1c63be8f59a6,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:28:44.286406 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bb587aee-9d40-4914-afca-6c0cadd995c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:28:44.296727 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:28:44.311920 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:28:44.312744 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:28:44.313141 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:44.313643 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:44.314320 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:44.314749 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] Filtering removed all hosts for the request with volume ID 'a012a7a9-bf44-4c35-a89f-1c63be8f59a6'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:28:44.315267 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] Filtering removed all hosts for the request with volume ID 'a012a7a9-bf44-4c35-a89f-1c63be8f59a6'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:28:44.315870 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:28:44.316349 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] Creating message record for request_id = req-c2156865-7a37-4bde-9a89-12d80ca28061 Aug 20 21:28:44.330204 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:28:44.330584 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] Setting Volume a012a7a9-bf44-4c35-a89f-1c63be8f59a6 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:28:44.342120 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bb587aee-9d40-4914-afca-6c0cadd995c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:28:44.345268 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c2156865-7a37-4bde-9a89-12d80ca28061 tempest-VolumesTransfersTest-1235742183 None] Flow 'volume_create_scheduler' (06e27cdb-114d-4f49-9903-a60c47435ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:28:49.943464 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] Flow 'volume_create_scheduler' (6ea7a4ab-9d19-48fb-acc1-a35422db0e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:28:49.947572 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (79951185-3009-466a-bae7-93af461c44cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:28:49.951373 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (79951185-3009-466a-bae7-93af461c44cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bf7469f0-5091-4144-9f3a-450c56735c0c),volume_id=bf7469f0-5091-4144-9f3a-450c56735c0c,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:28:49.954845 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6b778b8d-3d17-4b83-be7f-a327a3ccbaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:28:49.964351 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:28:49.978968 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:28:49.979666 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:28:49.979953 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:49.980483 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:49.980979 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:49.981587 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] Filtering removed all hosts for the request with volume ID 'bf7469f0-5091-4144-9f3a-450c56735c0c'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:28:49.982086 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] Filtering removed all hosts for the request with volume ID 'bf7469f0-5091-4144-9f3a-450c56735c0c'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:28:49.982725 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:28:49.983442 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] Creating message record for request_id = req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 Aug 20 21:28:49.993427 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:28:49.994129 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] Setting Volume bf7469f0-5091-4144-9f3a-450c56735c0c to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:28:50.007746 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6b778b8d-3d17-4b83-be7f-a327a3ccbaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:28:50.011617 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-bfbe9a4d-84ee-42a2-b566-64ae7e525795 tempest-VolumesBackupsTest-247057733 None] Flow 'volume_create_scheduler' (6ea7a4ab-9d19-48fb-acc1-a35422db0e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:28:51.543462 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] Flow 'volume_create_scheduler' (cde4c49b-5035-487e-b031-8f15134ca831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:28:51.548507 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9dbb54b3-16d0-48f6-85e2-60fa08163cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:28:51.552989 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9dbb54b3-16d0-48f6-85e2-60fa08163cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=cdbd7b72-a449-4911-a314-de189b7a9b1c,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5765c4ad-2a95-499e-baaa-7def0a623787),volume_id=5765c4ad-2a95-499e-baaa-7def0a623787,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:28:51.557879 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (22d8e841-2564-48dc-93a4-12f0b690bbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:28:51.570034 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:28:51.590048 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:28:51.591143 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:28:51.591732 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:51.592304 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:51.608351 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:51.609140 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] Filtering removed all hosts for the request with volume ID '5765c4ad-2a95-499e-baaa-7def0a623787'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:28:51.610270 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] Filtering removed all hosts for the request with volume ID '5765c4ad-2a95-499e-baaa-7def0a623787'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:28:51.611263 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:28:51.612184 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] Creating message record for request_id = req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 Aug 20 21:28:51.625990 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:28:51.627080 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] Setting Volume 5765c4ad-2a95-499e-baaa-7def0a623787 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:28:51.648001 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (22d8e841-2564-48dc-93a4-12f0b690bbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:28:51.652384 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-6432cb8c-c99d-4816-a3f2-aa47dd6cc046 tempest-VolumesBackupsTest-247057733 None] Flow 'volume_create_scheduler' (cde4c49b-5035-487e-b031-8f15134ca831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:28:55.372650 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] Flow 'volume_create_scheduler' (05596b1a-5501-4a87-8fba-67da7d5d6d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:28:55.377105 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (82f9373a-5b9c-4616-8e51-eb603986168a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:28:55.381128 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (82f9373a-5b9c-4616-8e51-eb603986168a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ba61c600-3f2f-4c62-ae0b-b9e9720f0216),volume_id=ba61c600-3f2f-4c62-ae0b-b9e9720f0216,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:28:55.384486 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5d01d9b8-3a97-4e04-8c7b-16aa7d3722ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:28:55.392324 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:28:55.406169 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:28:55.406530 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:28:55.406884 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:55.407228 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:55.407566 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:28:55.407903 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] Filtering removed all hosts for the request with volume ID 'ba61c600-3f2f-4c62-ae0b-b9e9720f0216'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:28:55.408243 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] Filtering removed all hosts for the request with volume ID 'ba61c600-3f2f-4c62-ae0b-b9e9720f0216'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:28:55.408740 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:28:55.409223 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] Creating message record for request_id = req-c570957b-3fc7-40bb-b72c-912ed5e76102 Aug 20 21:28:55.416559 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:28:55.416926 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] Setting Volume ba61c600-3f2f-4c62-ae0b-b9e9720f0216 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:28:55.427989 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5d01d9b8-3a97-4e04-8c7b-16aa7d3722ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:28:55.431142 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-c570957b-3fc7-40bb-b72c-912ed5e76102 tempest-VolumesSnapshotNegativeTestJSON-1715207708 None] Flow 'volume_create_scheduler' (05596b1a-5501-4a87-8fba-67da7d5d6d1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:29:23.512175 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=53,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:29:26.886690 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-a14c0e8e-2271-4829-b997-13bb4527b850 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:30:03.520576 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:30:26.884614 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-ca91d090-859e-4e09-8f89-5217399abc40 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:30:43.530246 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:31:23.534961 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:31:26.879893 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-0381c1cd-7eed-480f-8fff-1356d203b07c None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:32:03.537683 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:32:26.887621 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-9975c3f4-0acb-401a-9f9d-c9664c0d2b65 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:32:33.554495 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:33:13.559446 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:33:26.885758 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-40d8ff5f-9707-42bd-9a68-9c86036811c3 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:33:53.560973 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:34:23.582411 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:34:26.884674 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-c7546427-5794-445a-b957-6e7202d15e27 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:34:53.592202 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:35:23.596582 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:35:26.884440 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-e3697af2-7884-47f6-9a6e-28b19256f75e None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:35:53.613399 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:36:26.881599 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-61422fe7-898a-42a1-84b1-bc21411df929 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:36:33.612662 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:37:13.620995 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:37:26.881003 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-47825c89-ec37-4dd3-979e-a7e7241dbe81 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:37:43.633474 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:38:23.633221 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:38:26.879238 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-5bc5dd89-a1d1-4a40-863e-ad55e549153b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:39:03.634851 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:39:26.878156 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-ba2196a5-aead-4bf7-9583-1748cc1215c9 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:39:43.634539 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:40:13.647396 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:40:26.874758 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-630f4a65-61b9-40d7-a450-162c785e6cb2 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:40:43.657075 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:41:13.667862 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:41:26.870694 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-846227f8-5321-4ae1-b3c8-26fe866f1d8a None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:41:43.677542 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:42:23.669384 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:42:26.880165 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-2eddbb25-9a7f-4c7a-906f-7fe080bb7522 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:42:53.680123 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:43:26.878938 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-6005f3f7-2f30-4cf9-9fa7-9750adafb8c0 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:43:33.690905 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:44:03.691781 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:44:26.877164 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-3b64e744-18d5-40f5-9b97-32b5a54fddf8 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:44:32.256840 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] Flow 'volume_create_scheduler' (f437fa6d-6b62-4330-9443-4f922ca7b286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:44:32.260952 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (46819b88-1662-493e-9463-c2e85a345924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:44:32.264791 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (46819b88-1662-493e-9463-c2e85a345924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(81346248-3085-4eea-b940-f92383bf2df0),volume_id=81346248-3085-4eea-b940-f92383bf2df0,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:44:32.268128 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fc088cf2-0b89-4772-a3aa-2d259a29a4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:44:32.276627 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:44:32.290794 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:44:32.291189 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:44:32.291545 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:44:32.291895 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:44:32.292235 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:44:32.292612 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] Filtering removed all hosts for the request with volume ID '81346248-3085-4eea-b940-f92383bf2df0'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:44:32.292955 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] Filtering removed all hosts for the request with volume ID '81346248-3085-4eea-b940-f92383bf2df0'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:44:32.293600 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:44:32.293845 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] Creating message record for request_id = req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea Aug 20 21:44:32.305526 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:44:32.305900 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] Setting Volume 81346248-3085-4eea-b940-f92383bf2df0 to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:44:32.320504 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fc088cf2-0b89-4772-a3aa-2d259a29a4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:44:32.325591 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-e106130d-d6c8-4d5d-b011-4b9a9bce6dea tempest-ServerActionsTestJSON-2025106041 None] Flow 'volume_create_scheduler' (f437fa6d-6b62-4330-9443-4f922ca7b286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:44:43.697642 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=24,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:45:23.707447 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:45:26.875779 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-7c22c1de-01da-470d-b6a4-522fb79e1645 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:46:03.710819 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:46:19.184951 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] Flow 'volume_create_scheduler' (b9538059-a273-49bb-95ac-004fd60724e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:46:19.189019 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6280ac87-4555-45b4-a1f9-3ea7f7c6e88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:46:19.192899 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6280ac87-4555-45b4-a1f9-3ea7f7c6e88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(cd70f168-6f94-4704-b73c-646f942a099d),volume_id=cd70f168-6f94-4704-b73c-646f942a099d,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:46:19.196209 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (afdd4084-1428-4e39-98c7-0c59f7299439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:46:19.206146 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:46:19.221223 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:46:19.221589 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:46:19.221960 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:46:19.222302 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:46:19.222648 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:46:19.222995 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] Filtering removed all hosts for the request with volume ID 'cd70f168-6f94-4704-b73c-646f942a099d'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:46:19.223341 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] Filtering removed all hosts for the request with volume ID 'cd70f168-6f94-4704-b73c-646f942a099d'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:46:19.223824 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:46:19.224257 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] Creating message record for request_id = req-75f7abf1-6979-4b73-b614-790221584b15 Aug 20 21:46:19.234071 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:46:19.234519 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] Setting Volume cd70f168-6f94-4704-b73c-646f942a099d to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:46:19.246330 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (afdd4084-1428-4e39-98c7-0c59f7299439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:46:19.249736 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-75f7abf1-6979-4b73-b614-790221584b15 tempest-TestMinimumBasicScenario-2001503068 None] Flow 'volume_create_scheduler' (b9538059-a273-49bb-95ac-004fd60724e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:46:26.870037 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-1b186853-684b-49f0-a6ba-135214da7897 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:46:43.723290 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:46:51.501047 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] Flow 'volume_create_scheduler' (a6828dfa-71b6-433e-9c69-dd6cef9daf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:46:51.505656 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e419ae00-f240-4c2c-9c20-c69e8c1688de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:46:51.509564 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e419ae00-f240-4c2c-9c20-c69e8c1688de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4be11df0-0441-424e-ac70-fa78a2688bfe),volume_id=4be11df0-0441-424e-ac70-fa78a2688bfe,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:46:51.512985 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e5f319d2-88d7-4dc2-829f-f0c0893a4533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 21:46:51.522612 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 21:46:51.536405 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 21:46:51.536782 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 21:46:51.537145 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:46:51.537498 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:46:51.537845 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 21:46:51.538200 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] Filtering removed all hosts for the request with volume ID '4be11df0-0441-424e-ac70-fa78a2688bfe'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 21:46:51.538543 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] Filtering removed all hosts for the request with volume ID '4be11df0-0441-424e-ac70-fa78a2688bfe'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 21:46:51.539026 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 21:46:51.539446 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] Creating message record for request_id = req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 Aug 20 21:46:51.546727 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 21:46:51.547095 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] Setting Volume 4be11df0-0441-424e-ac70-fa78a2688bfe to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 21:46:51.558680 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e5f319d2-88d7-4dc2-829f-f0c0893a4533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 21:46:51.561916 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-7c6ed2a9-5861-4a1e-af69-cbcb4d8b6c90 tempest-TestMinimumBasicScenario-2001503068 None] Flow 'volume_create_scheduler' (a6828dfa-71b6-433e-9c69-dd6cef9daf1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 21:47:23.723339 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:48:03.715769 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:48:26.872307 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-d6668240-810c-4533-bfa7-81b5c376f0d8 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:48:43.716284 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:49:13.734842 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:49:26.871273 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-b68229df-c987-4063-a027-5eb794f33d4b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:49:53.725922 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:50:23.735713 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:50:26.870532 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-629eab7a-0251-4c63-812d-5bfb44f3a9e6 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:51:03.745440 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:51:26.866737 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-43a736bf-d6a6-4cbd-92f2-8e64b4b241c6 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:51:33.770620 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:52:13.760188 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:52:26.875284 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-ede50410-6014-4353-a111-8b6df7fb8e8a None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:52:53.763017 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:53:26.871149 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-3ae4c10c-644d-49bc-9289-1e44db6503b6 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:53:33.752118 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:54:03.765774 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:54:26.879161 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-8904e11d-2be1-44be-9cd8-cae2bacdd27b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:54:43.756707 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:55:23.762599 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:55:26.877075 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-60437026-34a2-46d9-b9ac-bc52ff9be930 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:55:53.777190 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:56:13.779410 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:56:26.876237 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-aa58efd0-9bba-4f40-83eb-891bba5d3a71 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:56:53.777675 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:57:23.791466 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:57:26.874473 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-4abdcd4d-41f9-41cf-90f9-2b9a51bdff7b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:58:03.792561 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:58:26.873001 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-4a361d99-2c28-4d5c-8583-2c12d81d7eb9 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:58:43.790229 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:59:13.806429 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 21:59:26.872162 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-807e58ea-7d83-4ab0-b1ae-90a3c8dec343 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 21:59:53.804998 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:00:26.868680 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-7786e8fb-5c5a-447a-9d20-3496b489aaca None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 22:00:33.799844 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:01:03.817774 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:01:26.868683 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-8869f224-a9c7-445e-bcc5-bc5dc76f7458 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 22:01:33.830894 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:01:50.981890 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] Flow 'volume_create_scheduler' (fb2c9535-f151-4a2f-a937-aac807653332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 22:01:50.986464 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4a8aa2e6-5302-4cd3-bdc9-b5e76bbfab02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 22:01:50.990871 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4a8aa2e6-5302-4cd3-bdc9-b5e76bbfab02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=cdbd7b72-a449-4911-a314-de189b7a9b1c,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4bc517d6-5501-422a-ab35-e306b83675be),volume_id=4bc517d6-5501-422a-ab35-e306b83675be,volume_properties=VolumeProperties,volume_type=VolumeType(6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf))}' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 22:01:50.994269 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (12dbddf0-4aa7-4231-9b7e-49b58b14daba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Aug 20 22:01:51.002735 ncdv-master-1 cinder-scheduler[137470]: DEBUG oslo_db.sqlalchemy.engines [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 20 22:01:51.017313 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.host_manager [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] volume service is down. (host: ncdv-master-1@ceph) Aug 20 22:01:51.017680 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] Starting with 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Aug 20 22:01:51.018009 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 22:01:51.018383 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] Filter CapacityFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 22:01:51.018728 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=137470) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Aug 20 22:01:51.019071 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.base_filter [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] Filtering removed all hosts for the request with volume ID '4bc517d6-5501-422a-ab35-e306b83675be'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=137470) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Aug 20 22:01:51.019945 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.scheduler.base_filter [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] Filtering removed all hosts for the request with volume ID '4bc517d6-5501-422a-ab35-e306b83675be'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Aug 20 22:01:51.020426 ncdv-master-1 cinder-scheduler[137470]: WARNING cinder.scheduler.filter_scheduler [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] No weighed backend found for volume with properties: {'id': '6eb1493d-0fbe-4367-a3ee-6c275aa9a4bf', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-20T20:45:33.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Aug 20 22:01:51.020877 ncdv-master-1 cinder-scheduler[137470]: INFO cinder.message.api [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] Creating message record for request_id = req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 Aug 20 22:01:51.028545 ncdv-master-1 cinder-scheduler[137470]: ERROR cinder.scheduler.flows.create_volume [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Aug 20 22:01:51.028916 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.volume.flows.common [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] Setting Volume 4bc517d6-5501-422a-ab35-e306b83675be to error due to: No valid backend was found. No weighed backends available {{(pid=137470) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Aug 20 22:01:51.040221 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (12dbddf0-4aa7-4231-9b7e-49b58b14daba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=137470) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Aug 20 22:01:51.043353 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.manager [None req-ca183fd5-646b-44b1-9ee3-6b71596ec7b9 tempest-TestShelveInstance-362621940 None] Flow 'volume_create_scheduler' (fb2c9535-f151-4a2f-a937-aac807653332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=137470) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Aug 20 22:02:13.821828 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=6,cinder:SELECT=21,cinder:INSERT=1,cinder:DELETE=1 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:02:26.867935 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-e1146ef9-de57-40b7-bc8a-b36ca50ab3e7 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 22:02:53.820004 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:03:23.831950 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:03:26.864325 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-a2eb5cf9-505d-4cad-af83-f61452ea7d2d None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 22:03:53.841685 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:04:26.871801 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-8f504e99-6e13-49df-9705-1c41ef3e8487 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 22:04:33.838796 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:05:13.841853 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:05:26.868433 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-b07e6ab3-2a8f-4324-94f1-e2bb84ecdfa2 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 22:05:43.850152 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:06:13.861971 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:06:26.865301 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-283f0049-c8cd-4e31-9326-4e99f1908bd1 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 22:06:43.873383 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:07:23.871820 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:07:26.870379 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-d8f6bc37-88e7-4d25-af8c-20518349676f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 22:08:03.870834 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:08:26.870183 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-ff2d2d82-2381-4c77-967f-5f466b3984fa None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 22:08:43.874945 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:09:13.894700 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:09:26.868543 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-34bddec5-c1f3-4e18-a914-787b9e61a483 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 22:09:43.909695 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:10:23.909925 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:10:26.867443 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-fc9f4700-030c-470b-8b49-1f891fdb555e None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 22:11:03.913046 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:11:26.867100 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-cbe033af-c1b5-4342-a29f-9df8c3b8f28d None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 22:11:43.921115 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:12:13.943006 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:12:26.866322 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-2da42cfc-65f3-478d-b28f-b2cef4a1278c None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 22:12:53.942383 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:13:26.865672 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-9c02954a-4346-4922-a774-1027f3613630 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 22:13:33.949707 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:14:03.963349 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 20 22:14:26.863468 ncdv-master-1 cinder-scheduler[137470]: DEBUG cinder.scheduler.host_manager [None req-af97d9c3-bfc7-4538-aa64-0b1f8ca7e09d None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=137470) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Aug 20 22:14:43.962527 ncdv-master-1 cinder-scheduler[137470]: DEBUG dbcounter [-] [137470] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=137470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}