-- Logs begin at Sat 2022-09-24 20:01:15 UTC, end at Sat 2022-09-24 22:17:41 UTC. -- Sep 24 20:40:06.112036 ncdv-master-1 systemd[1]: Started Devstack devstack@c-sch.service. Sep 24 20:40:09.849910 ncdv-master-1 cinder-scheduler[132381]: INFO dbcounter [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] Registered counter for database cinder Sep 24 20:40:09.849910 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:40:09.849910 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writer thread running {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:40:10.079408 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.rpc [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 24 20:40:10.084190 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.rpc [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Sep 24 20:40:10.091108 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:40:10.095597 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.rpc [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Sep 24 20:40:10.100430 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.rpc [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Sep 24 20:40:10.105083 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.rpc [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 24 20:40:10.110212 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.rpc [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 24 20:40:10.117117 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:40:10.140803 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_concurrency.lockutils [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] Acquiring lock "singleton_lock" {{(pid=132381) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 20:40:10.141583 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_concurrency.lockutils [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] Acquired lock "singleton_lock" {{(pid=132381) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 20:40:10.142365 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_concurrency.lockutils [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] Releasing lock "singleton_lock" {{(pid=132381) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 20:40:10.143153 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] ******************************************************************************** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 20:40:10.143777 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] Configuration options gathered from: {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 20:40:10.144383 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 20:40:10.145344 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 20:40:10.145929 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] ================================================================================ {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 20:40:10.146699 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] allocated_capacity_weight_multiplier = -1.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.147356 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] allow_availability_zone_fallback = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.148126 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] allow_compression_on_image_upload = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.148760 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] allowed_direct_url_schemes = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.149552 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] api_rate_limit = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.150612 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] auth_strategy = keystone {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.151249 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] az_cache_duration = 3600 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.151835 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backdoor_port = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.152381 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backdoor_socket = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.152970 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_availability_zone = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.154026 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backup_api_class = cinder.backup.api.API {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.155053 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.155947 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backup_name_template = backup-%s {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.156576 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backup_use_same_host = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.157168 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backup_use_temp_snapshot = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.157812 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] capacity_weight_multiplier = 1.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.158573 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] chap_password = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.159253 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] chap_username = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.159993 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.160956 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_internal_tenant_project_id = 8e368838cf0844c799bbf8bbd5b5a803 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.161559 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_internal_tenant_user_id = c66ad10d7496429da3b81648cf9e83f3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.162257 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cloned_volume_same_az = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.163392 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] compression_format = gzip {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.164023 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] compute_api_class = cinder.compute.nova.API {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.164667 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] config_dir = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.165207 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.166163 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] config_source = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.166817 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.167495 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] control_exchange = openstack {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.168381 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] debug = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.169501 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] default_availability_zone = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.170327 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] default_group_type = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.171868 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.174072 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] default_volume_type = ceph {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.175311 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] driver_client_cert = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.179343 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] driver_client_cert_key = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.180324 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] driver_data_namespace = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.181305 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] driver_ssl_cert_path = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.182056 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] driver_ssl_cert_verify = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.182730 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] driver_use_ssl = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.183406 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] enable_force_upload = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.184035 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] enable_new_services = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.184722 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] enable_unsupported_driver = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.185958 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] enabled_backends = ['ceph'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.186646 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] enforce_multipath_for_image_xfer = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.187278 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] filter_function = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.187909 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_api_insecure = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.188741 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_api_servers = ['http://10.222.0.52/image'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.189394 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_api_ssl_compression = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.190126 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_ca_certificates_file = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.190788 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_catalog_info = image:glance:publicURL {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.191582 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_certfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.192359 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.192946 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_keyfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.193539 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_num_retries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.194170 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_request_timeout = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.194797 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] goodness_function = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.195466 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] graceful_shutdown_timeout = 5 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.196065 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] group_api_class = cinder.group.api.API {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.196700 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] host = ncdv-master-1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.197311 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iet_conf = /etc/iet/ietd.conf {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.197899 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_compress_on_upload = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.199148 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_conversion_address_space_limit = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.199783 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_conversion_cpu_limit = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.200687 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.201384 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_conversion_disable = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.202184 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_upload_use_cinder_backend = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.202815 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_upload_use_internal_tenant = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.203608 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_volume_cache_enabled = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.204198 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_volume_cache_max_count = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.204830 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_volume_cache_max_size_gb = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.205439 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] instance_format = [instance: %(uuid)s] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.206036 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.206699 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iscsi_iotype = fileio {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.207294 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iscsi_secondary_ip_addresses = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.207887 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iscsi_target_flags = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.208702 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iscsi_write_cache = on {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.209511 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iser_helper = tgtadm {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.210221 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iser_ip_address = 10.222.0.52 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.210933 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iser_port = 3260 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.211791 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.212469 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_config_append = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.213108 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.213684 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_dir = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.214275 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_file = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.214904 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_options = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.215481 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_rotate_interval = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.216107 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_rotate_interval_type = days {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.216696 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_rotation_type = none {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.217224 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.217768 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.218354 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.219170 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.219833 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.220431 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] max_age = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.221141 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] max_logfile_count = 30 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.221912 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] max_logfile_size_mb = 200 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.222665 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] max_over_subscription_ratio = 20.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.223258 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] message_reap_interval = 86400 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.223881 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] message_ttl = 2592000 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.224464 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] monkey_patch = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.225055 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] monkey_patch_modules = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.225577 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] my_ip = 10.222.0.52 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.226177 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] no_snapshot_gb_quota = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.226801 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] num_iser_scan_tries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.227428 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] num_shell_tries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.228042 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] num_volume_device_scan_tries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.228732 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nvmet_ns_id = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.229569 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nvmet_port_id = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.230165 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] osapi_max_limit = 1000 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.230925 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] osapi_volume_ext_list = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.232306 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.232973 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] osapi_volume_listen = 0.0.0.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.233567 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] osapi_volume_listen_port = 8776 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.234174 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] osapi_volume_use_ssl = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.234809 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] osapi_volume_workers = 2 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.235389 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] per_volume_size_limit = -1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.236197 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] periodic_fuzzy_delay = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.236875 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] periodic_interval = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.237500 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] project_id_regex = [0-9a-f\-]+ {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.238080 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] public_endpoint = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.238733 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] publish_errors = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.239520 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_backup_gigabytes = 1000 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.240344 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_backups = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.241424 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_consistencygroups = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.242292 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.242993 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_gigabytes = 1000 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.243795 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_groups = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.244431 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_snapshots = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.245058 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_volumes = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.245646 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] rate_limit_burst = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.246342 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] rate_limit_except_level = CRITICAL {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.247014 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] rate_limit_interval = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.248189 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] replication_device = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.248782 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] report_discard_supported = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.249579 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] report_interval = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.250353 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] reservation_clean_interval = 86400 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.250933 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] reservation_expire = 86400 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.251611 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] reserved_percentage = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.252533 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.253823 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.254516 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] rpc_response_timeout = 120 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.255146 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] run_external_periodic_tasks = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.255762 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_default_filters = ['AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.256481 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_default_weighers = ['CapacityWeigher'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.257086 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_driver = cinder.scheduler.filter_scheduler.FilterScheduler {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.257673 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_driver_init_wait_time = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.258259 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_host_manager = cinder.scheduler.host_manager.HostManager {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.258896 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_json_config_location = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.259711 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.260410 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_max_attempts = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.261006 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_weight_handler = cinder.scheduler.weights.OrderedHostWeightHandler {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.261694 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scst_target_driver = iscsi {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.262265 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scst_target_iqn_name = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.263082 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_down_time = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.263694 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] snapshot_name_template = snapshot-%s {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.264275 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] snapshot_same_host = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.264918 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] split_loggers = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.265529 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] state_path = /opt/stack/data/cinder {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.266129 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] storage_availability_zone = nova {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.266854 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] storage_protocol = iSCSI {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.267462 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] syslog_log_facility = LOG_USER {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.268119 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] target_helper = lioadm {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.268821 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] target_ip_address = 10.222.0.52 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.269662 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] target_port = 3260 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.270423 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.271111 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] target_protocol = iscsi {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.271796 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] trace_flags = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.272394 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] transfer_api_class = cinder.transfer.api.API {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.275557 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] transport_url = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.277069 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] until_refresh = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.279001 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_chap_auth = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.281681 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_default_quota_class = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.281890 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_eventlog = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.282490 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_journal = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.283109 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_json = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.283706 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_multipath_for_image_xfer = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.284466 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_stderr = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.285139 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_syslog = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.285768 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] verify_glance_signatures = enabled {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.286375 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_api_class = cinder.volume.api.API {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.287055 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_backend_name = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.287783 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_clear = zero {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.288360 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_clear_ionice = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.288949 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_clear_size = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.289550 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.290358 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_copy_bps_limit = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.291065 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_dd_blocksize = 1M {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.291657 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.293557 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_name_template = volume-%s {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.294603 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_number_multiplier = -1.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.295114 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_usage_audit_period = month {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.295756 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.296314 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] watch_log_file = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.296883 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.299257 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.304017 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_concurrency.disable_process_locking = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.304017 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.304017 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.304017 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.304017 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.304017 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.305031 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.305031 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.admin_password = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.305031 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.305835 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.admin_token = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.306593 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.admin_user = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.318933 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_admin_prefix = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.319712 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.320342 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_port = 35357 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.320999 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_protocol = https {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.321591 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_section = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.322213 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_type = password {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.323015 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_uri = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.323667 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_version = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.325200 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.cache = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.328249 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.329039 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.certfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.330665 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.delay_auth_decision = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.331328 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.332709 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.http_connect_timeout = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.333329 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.334927 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.identity_uri = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.335646 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.include_service_catalog = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.336260 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.insecure = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.336888 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.interface = public {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.338328 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.keyfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.338947 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.340253 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.341025 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.341746 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.342350 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.342973 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.344490 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.345108 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.346431 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.347055 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.region_name = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.348389 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.348986 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.service_token_roles_required = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.349581 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.service_type = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.351033 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.token_cache_time = 300 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.351636 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.352262 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.backend = dogpile.cache.null {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.352848 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.backend_argument = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.353443 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.config_prefix = cache.oslo {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.354039 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.dead_timeout = 60.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.354724 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.debug_cache_backend = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.355314 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.enable_retry_client = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.355911 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.enable_socket_keepalive = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.357124 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.enabled = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.358169 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.expiration_time = 600 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.358960 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.hashclient_retry_attempts = 2 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.359571 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.hashclient_retry_delay = 1.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.360163 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_dead_retry = 300 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.360769 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_password = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.361363 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.361952 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.362561 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_pool_maxsize = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.363170 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.363752 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_sasl_enabled = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.364424 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.365017 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_socket_timeout = 1.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.365669 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_username = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.366260 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.proxies = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.366898 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.retry_attempts = 2 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.367563 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.retry_delay = 0.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.368697 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.socket_keepalive_count = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.369284 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.socket_keepalive_idle = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.369955 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.socket_keepalive_interval = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.370565 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.tls_allowed_ciphers = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.371144 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.tls_cafile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.371718 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.tls_certfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.372870 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.tls_enabled = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.373462 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.tls_keyfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.374064 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] coordination.backend_url = etcd3+http://10.222.0.52:2379 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.374701 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.backend = sqlalchemy {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.375325 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.connection = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.375940 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.connection_debug = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.376535 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.connection_parameters = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.377132 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.connection_recycle_time = 3600 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.377744 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.connection_trace = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.378968 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.db_inc_retry_interval = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.379559 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.db_max_retries = 20 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.380254 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.db_max_retry_interval = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.380877 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.db_retry_interval = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.382037 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.max_overflow = 50 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.382680 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.max_pool_size = 5 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.383287 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.max_retries = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.383921 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.mysql_enable_ndb = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.384596 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.385177 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.pool_timeout = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.385778 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.retry_interval = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.386357 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.slave_connection = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.386977 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.sqlite_synchronous = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.387894 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.use_db_reconnect = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.389133 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.enforce_new_defaults = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.389722 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.enforce_scope = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.390322 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.policy_default_rule = default {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.390959 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.391561 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.policy_file = policy.yaml {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.392178 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.392764 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.393362 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.393937 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.394562 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.395188 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.connection_string = messaging:// {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.395781 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.enabled = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.396408 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.es_doc_type = notification {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.397012 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.es_scroll_size = 10000 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.397603 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.es_scroll_time = 2m {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.398237 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.filter_error_trace = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.399501 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.hmac_keys = SECRET_KEY {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.400286 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.sentinel_service_name = mymaster {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.400901 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.socket_timeout = 0.1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.401493 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.trace_sqlalchemy = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.402075 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] os_brick.lock_path = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.402711 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] privsep_osbrick.capabilities = [21] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.403915 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] privsep_osbrick.group = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.404743 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] privsep_osbrick.helper_command = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.405331 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.405930 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.406504 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] privsep_osbrick.user = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.407160 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.407736 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_sys_admin.group = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.408333 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_sys_admin.helper_command = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.409597 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.410192 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.410831 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_sys_admin.user = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.411432 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.auth_section = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.412021 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.auth_type = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.412591 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.cafile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.413163 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.certfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.413759 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.collect_timing = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.414370 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.insecure = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.414982 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.keyfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.415573 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.send_service_user_token = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.416175 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.split_loggers = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.416757 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.timeout = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.417372 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.backend_availability_zone = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.417964 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.chap_password = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.418602 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.chap_username = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.420155 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.420737 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.driver_client_cert = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.421342 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.driver_client_cert_key = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.421932 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.driver_data_namespace = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.422547 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.423142 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.423753 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.driver_use_ssl = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.424354 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.enable_unsupported_driver = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.424933 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.425508 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.filter_function = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.426223 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.goodness_function = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.427070 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.427679 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.428280 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.428925 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.430183 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.430810 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.431495 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iscsi_iotype = fileio {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.432326 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.433249 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iscsi_target_flags = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.434161 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iscsi_write_cache = on {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.435622 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iser_helper = tgtadm {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.436934 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iser_ip_address = 10.222.0.52 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.437803 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iser_port = 3260 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.438484 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.439158 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.440376 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.441022 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.num_shell_tries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.441624 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.442222 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.443476 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.nvmet_port_id = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.444070 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.replication_device = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.444655 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.report_discard_supported = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.445296 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.reserved_percentage = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.445913 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.scst_target_driver = iscsi {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.446491 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.scst_target_iqn_name = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.447119 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.storage_protocol = iSCSI {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.447714 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.target_helper = tgtadm {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.448425 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.target_ip_address = 10.222.0.52 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.449044 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.target_port = 3260 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.450264 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.451064 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.target_protocol = iscsi {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.452567 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.trace_flags = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.453178 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.unique_fqdn_network = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.453765 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.use_chap_auth = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.454367 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.454980 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volume_backend_name = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.455581 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volume_clear = zero {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.456210 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volume_clear_ionice = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.456792 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volume_clear_size = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.458086 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.458733 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.459353 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.460706 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.461307 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_reports.file_event_handler = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.461895 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.462490 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_reports.log_dir = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.463132 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.463719 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.464302 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.464886 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.465561 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.467020 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.467608 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.468192 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.468796 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.469397 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.470720 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.471318 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.471917 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.472521 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.473116 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.473769 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.474349 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.475019 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.475597 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.476175 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.476775 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.477360 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.477938 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.478577 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.479180 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.479791 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.ssl = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.481110 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.481799 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.482384 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.483005 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.483603 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.ssl_version = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.484227 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_notifications.driver = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.484806 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_notifications.retry = -1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.485430 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.486019 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_notifications.transport_url = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.486629 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.auth_section = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.487253 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.auth_type = password {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.487855 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.488442 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.certfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.489036 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.collect_timing = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.489629 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.insecure = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.491002 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.interface = public {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.491607 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.keyfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.492694 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.region_name = RegionOne {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.493318 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.split_loggers = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.493895 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.timeout = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.494536 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.token_auth_url = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.495079 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] ******************************************************************************** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 20:40:10.495792 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] Full set of CONF: {{(pid=132381) _wait_for_exit_or_signal /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:362}} Sep 24 20:40:10.496281 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] ******************************************************************************** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 20:40:10.496779 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] Configuration options gathered from: {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 20:40:10.497826 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 20:40:10.498337 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 20:40:10.498847 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] ================================================================================ {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 20:40:10.499424 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] allocated_capacity_weight_multiplier = -1.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.499915 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] allow_availability_zone_fallback = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.501109 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] allow_compression_on_image_upload = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.501623 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] allowed_direct_url_schemes = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.502129 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] api_rate_limit = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.502655 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] auth_strategy = keystone {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.503149 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] az_cache_duration = 3600 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.503636 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backdoor_port = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.504139 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backdoor_socket = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.504638 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_availability_zone = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.505128 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backup_api_class = cinder.backup.api.API {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.505615 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.506101 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backup_name_template = backup-%s {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.506639 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backup_use_same_host = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.507148 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backup_use_temp_snapshot = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.507649 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] capacity_weight_multiplier = 1.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.508135 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] chap_password = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.508631 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] chap_username = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.509135 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.509642 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_internal_tenant_project_id = 8e368838cf0844c799bbf8bbd5b5a803 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.510129 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_internal_tenant_user_id = c66ad10d7496429da3b81648cf9e83f3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.511273 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cloned_volume_same_az = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.511769 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] compression_format = gzip {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.512275 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] compute_api_class = cinder.compute.nova.API {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.512834 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] config_dir = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.513338 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.513845 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] config_source = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.514345 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.514869 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] control_exchange = openstack {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.515355 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] debug = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.515857 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] default_availability_zone = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.516344 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] default_group_type = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.516877 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.517394 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] default_volume_type = ceph {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.517889 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] driver_client_cert = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.518398 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] driver_client_cert_key = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.518917 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] driver_data_namespace = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.519402 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] driver_ssl_cert_path = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.519886 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] driver_ssl_cert_verify = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.520369 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] driver_use_ssl = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.521524 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] enable_force_upload = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.522024 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] enable_new_services = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.522540 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] enable_unsupported_driver = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.523036 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] enabled_backends = ['ceph'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.523537 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] enforce_multipath_for_image_xfer = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.524024 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] filter_function = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.524538 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_api_insecure = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.525029 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_api_servers = ['http://10.222.0.52/image'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.526065 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_api_ssl_compression = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.526611 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_ca_certificates_file = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.527107 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_catalog_info = image:glance:publicURL {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.527617 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_certfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.528648 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.529407 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_keyfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.529898 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_num_retries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.530387 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] glance_request_timeout = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.531368 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] goodness_function = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.532103 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] graceful_shutdown_timeout = 5 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.532596 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] group_api_class = cinder.group.api.API {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.533087 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] host = ncdv-master-1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.533595 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iet_conf = /etc/iet/ietd.conf {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.534101 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_compress_on_upload = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.534623 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_conversion_address_space_limit = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.535125 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_conversion_cpu_limit = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.535626 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.536111 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_conversion_disable = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.536603 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_upload_use_cinder_backend = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.537103 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_upload_use_internal_tenant = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.537610 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_volume_cache_enabled = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.538096 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_volume_cache_max_count = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.538724 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] image_volume_cache_max_size_gb = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.539233 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] instance_format = [instance: %(uuid)s] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.539744 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.540232 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iscsi_iotype = fileio {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.540729 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iscsi_secondary_ip_addresses = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.541667 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iscsi_target_flags = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.542399 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iscsi_write_cache = on {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.543921 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iser_helper = tgtadm {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.544474 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iser_ip_address = 10.222.0.52 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.545124 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iser_port = 3260 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.545617 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.546110 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_config_append = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.546640 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.547157 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_dir = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.547646 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_file = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.548146 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_options = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.548644 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_rotate_interval = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.549141 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_rotate_interval_type = days {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.549646 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] log_rotation_type = none {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.550135 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.550685 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.551675 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.552464 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.553136 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.553625 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] max_age = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.554132 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] max_logfile_count = 30 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.554680 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] max_logfile_size_mb = 200 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.555194 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] max_over_subscription_ratio = 20.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.555695 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] message_reap_interval = 86400 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.556181 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] message_ttl = 2592000 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.556681 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] monkey_patch = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.557231 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] monkey_patch_modules = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.557735 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] my_ip = 10.222.0.52 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.558288 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] no_snapshot_gb_quota = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.558810 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] num_iser_scan_tries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.559306 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] num_shell_tries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.560602 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] num_volume_device_scan_tries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.561101 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nvmet_ns_id = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.562002 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nvmet_port_id = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.562771 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] osapi_max_limit = 1000 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.563365 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] osapi_volume_ext_list = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.563879 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.564372 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] osapi_volume_listen = 0.0.0.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.564873 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] osapi_volume_listen_port = 8776 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.565376 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] osapi_volume_use_ssl = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.565872 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] osapi_volume_workers = 2 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.566358 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] per_volume_size_limit = -1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.566879 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] periodic_fuzzy_delay = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.567369 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] periodic_interval = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.567857 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] project_id_regex = [0-9a-f\-]+ {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.568358 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] public_endpoint = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.568865 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] publish_errors = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.569351 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_backup_gigabytes = 1000 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.569853 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_backups = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.570347 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_consistencygroups = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.571338 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.572190 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_gigabytes = 1000 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.572910 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_groups = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.573498 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_snapshots = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.574001 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] quota_volumes = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.574541 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] rate_limit_burst = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.575095 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] rate_limit_except_level = CRITICAL {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.575613 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] rate_limit_interval = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.576106 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] replication_device = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.576593 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] report_discard_supported = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.577092 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] report_interval = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.577665 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] reservation_clean_interval = 86400 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.578154 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] reservation_expire = 86400 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.578674 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] reserved_percentage = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.579165 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.579673 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.580177 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] rpc_response_timeout = 120 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.580760 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] run_external_periodic_tasks = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.581279 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_default_filters = ['AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.582128 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_default_weighers = ['CapacityWeigher'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.582779 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_driver = cinder.scheduler.filter_scheduler.FilterScheduler {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.583493 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_driver_init_wait_time = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.583987 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_host_manager = cinder.scheduler.host_manager.HostManager {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.584478 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_json_config_location = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.584968 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.585455 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_max_attempts = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.585963 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scheduler_weight_handler = cinder.scheduler.weights.OrderedHostWeightHandler {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.586460 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scst_target_driver = iscsi {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.586985 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] scst_target_iqn_name = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.587499 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_down_time = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.587995 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] snapshot_name_template = snapshot-%s {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.588490 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] snapshot_same_host = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.588995 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] split_loggers = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.589483 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] state_path = /opt/stack/data/cinder {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.589987 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] storage_availability_zone = nova {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.590483 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] storage_protocol = iSCSI {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.591563 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] syslog_log_facility = LOG_USER {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.592446 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] target_helper = lioadm {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.593036 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] target_ip_address = 10.222.0.52 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.593728 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] target_port = 3260 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.594245 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.594771 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] target_protocol = iscsi {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.595283 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] trace_flags = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.595770 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] transfer_api_class = cinder.transfer.api.API {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.596257 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] transport_url = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.596742 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] until_refresh = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.597239 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_chap_auth = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.597734 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_default_quota_class = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.598228 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_eventlog = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.598753 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_journal = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.599242 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_json = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.599759 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_multipath_for_image_xfer = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.600250 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_stderr = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.600823 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] use_syslog = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.601373 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] verify_glance_signatures = enabled {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.601876 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_api_class = cinder.volume.api.API {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.602716 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_backend_name = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.603312 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_clear = zero {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.607875 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_clear_ionice = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.608466 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_clear_size = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.608996 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.609501 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_copy_bps_limit = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.610018 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_dd_blocksize = 1M {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.610552 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.611076 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_name_template = volume-%s {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.611583 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_number_multiplier = -1.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.612078 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volume_usage_audit_period = month {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.613060 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.613692 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] watch_log_file = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:40:10.614417 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.614959 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.615433 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_concurrency.disable_process_locking = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.615972 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.616479 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.617117 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.617623 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.618138 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.618696 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.619238 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.admin_password = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.619750 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.620347 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.admin_token = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.620914 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.admin_user = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.621534 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_admin_prefix = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.622135 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.623024 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_port = 35357 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.623689 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_protocol = https {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.624443 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_section = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.624984 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_type = password {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.625496 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_uri = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.626004 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.auth_version = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.626578 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.cache = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.627093 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.627601 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.certfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.628096 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.delay_auth_decision = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.628606 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.629102 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.http_connect_timeout = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.629615 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.630126 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.identity_uri = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.630647 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.include_service_catalog = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.631161 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.insecure = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.631667 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.interface = public {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.632174 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.keyfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.633045 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.633660 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.634170 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.634899 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.635420 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.635930 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.636425 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.636920 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.637620 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.638144 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.region_name = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.638746 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.639248 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.service_token_roles_required = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.639758 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.service_type = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.640283 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.token_cache_time = 300 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.641622 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.642159 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.backend = dogpile.cache.null {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.643033 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.backend_argument = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.643554 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.config_prefix = cache.oslo {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.644152 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.dead_timeout = 60.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.644867 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.debug_cache_backend = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.645378 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.enable_retry_client = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.645884 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.enable_socket_keepalive = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.646392 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.enabled = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.646915 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.expiration_time = 600 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.647422 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.hashclient_retry_attempts = 2 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.647933 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.hashclient_retry_delay = 1.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.648426 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_dead_retry = 300 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.648921 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_password = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.649423 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.649921 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.651180 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_pool_maxsize = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.651180 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.651180 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_sasl_enabled = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.651854 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.652354 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_socket_timeout = 1.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.653807 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.memcache_username = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.654957 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.proxies = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.655483 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.retry_attempts = 2 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.655995 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.retry_delay = 0.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.656495 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.socket_keepalive_count = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.656993 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.socket_keepalive_idle = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.657507 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.socket_keepalive_interval = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.658013 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.tls_allowed_ciphers = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.658545 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.tls_cafile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.659051 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.tls_certfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.659553 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.tls_enabled = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.660092 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cache.tls_keyfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.660601 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] coordination.backend_url = etcd3+http://10.222.0.52:2379 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.661128 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.backend = sqlalchemy {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.661649 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.connection = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.662163 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.connection_debug = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.662697 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.connection_parameters = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.663681 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.connection_recycle_time = 3600 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.664206 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.connection_trace = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.664806 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.db_inc_retry_interval = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.665481 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.db_max_retries = 20 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.665989 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.db_max_retry_interval = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.666559 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.db_retry_interval = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.667067 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.max_overflow = 50 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.667585 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.max_pool_size = 5 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.668097 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.max_retries = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.668599 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.mysql_enable_ndb = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.669672 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.670173 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.pool_timeout = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.670711 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.retry_interval = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.671239 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.slave_connection = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.671991 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.sqlite_synchronous = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.672497 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] database.use_db_reconnect = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.673182 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.enforce_new_defaults = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.673876 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.enforce_scope = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.674373 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.policy_default_rule = default {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.674926 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.675611 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.policy_file = policy.yaml {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.676126 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.676632 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.677126 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.677628 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.678132 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.678669 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.connection_string = messaging:// {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.679176 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.enabled = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.679684 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.es_doc_type = notification {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.680193 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.es_scroll_size = 10000 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.680779 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.es_scroll_time = 2m {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.681294 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.filter_error_trace = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.681984 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.hmac_keys = SECRET_KEY {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.684052 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.sentinel_service_name = mymaster {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.684597 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.socket_timeout = 0.1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.685101 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] profiler.trace_sqlalchemy = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.685833 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] os_brick.lock_path = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.686355 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] privsep_osbrick.capabilities = [21] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.686939 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] privsep_osbrick.group = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.687456 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] privsep_osbrick.helper_command = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.688045 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.688730 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.689245 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] privsep_osbrick.user = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.689754 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.690253 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_sys_admin.group = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.690783 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_sys_admin.helper_command = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.691291 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.691979 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.692491 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] cinder_sys_admin.user = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.693007 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.auth_section = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.693501 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.auth_type = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.694400 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.cafile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.698870 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.certfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.699388 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.collect_timing = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.699884 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.insecure = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.700636 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.keyfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.701135 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.send_service_user_token = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.701643 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.split_loggers = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.702306 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] service_user.timeout = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.702866 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.backend_availability_zone = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.703392 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.chap_password = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.703905 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.chap_username = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.704636 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.705143 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.driver_client_cert = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.705963 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.driver_client_cert_key = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.706467 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.driver_data_namespace = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.707013 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.707510 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.708018 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.driver_use_ssl = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.708605 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.enable_unsupported_driver = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.709111 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.709605 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.filter_function = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.710097 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.goodness_function = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.710634 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.711145 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.711648 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.712338 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.712834 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.713333 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.713858 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iscsi_iotype = fileio {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.714667 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.715202 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iscsi_target_flags = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.716430 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iscsi_write_cache = on {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.716938 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iser_helper = tgtadm {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.717441 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iser_ip_address = 10.222.0.52 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.717961 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iser_port = 3260 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.718477 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.719011 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.719511 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.720011 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.num_shell_tries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.720527 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.721035 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.721545 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.nvmet_port_id = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.722049 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.replication_device = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.722740 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.report_discard_supported = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.723266 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.reserved_percentage = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.723767 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.scst_target_driver = iscsi {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.724286 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.scst_target_iqn_name = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.725021 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.storage_protocol = iSCSI {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.725523 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.target_helper = tgtadm {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.726034 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.target_ip_address = 10.222.0.52 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.726746 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.target_port = 3260 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.727249 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.727761 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.target_protocol = iscsi {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.728262 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.trace_flags = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.728777 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.unique_fqdn_network = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.729286 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.use_chap_auth = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.729795 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.730294 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volume_backend_name = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.730835 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volume_clear = zero {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.731947 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volume_clear_ionice = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.732642 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volume_clear_size = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.733147 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.733659 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.734177 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.734974 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.735507 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_reports.file_event_handler = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.736022 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.736849 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_reports.log_dir = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.737370 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.737874 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.738387 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.738939 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.739441 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.739955 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.740458 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.740958 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.741512 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.742021 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.742717 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.743240 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.744283 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.745091 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.745610 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.746117 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.746923 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.747661 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.748175 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.748697 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.749199 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.749701 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.750203 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.750741 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.751260 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.751760 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.ssl = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.752260 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.752959 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.753470 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.753983 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.754490 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_rabbit.ssl_version = {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.755219 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_notifications.driver = [] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.755739 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_notifications.retry = -1 {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.756239 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.756945 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] oslo_messaging_notifications.transport_url = **** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.757596 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.auth_section = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.758120 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.auth_type = password {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.758674 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.759192 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.certfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.759696 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.collect_timing = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.760214 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.insecure = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.760735 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.interface = public {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.761246 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.keyfile = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.761774 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.region_name = RegionOne {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.762141 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.split_loggers = False {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.763684 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.timeout = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.764226 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] nova.token_auth_url = None {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:40:10.764590 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.service [None req-b31ee893-bbfb-410a-9cbc-acaa71bdc653 None None] ******************************************************************************** {{(pid=132381) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 20:40:10.765276 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.service [-] Starting cinder-scheduler node (version 21.1.0) Sep 24 20:40:10.766235 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.manager [None req-614375ac-edcc-4ee6-be09-5a49bd6e82a8 None None] Initiating service 1 cleanup Sep 24 20:40:10.775247 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.manager [None req-614375ac-edcc-4ee6-be09-5a49bd6e82a8 None None] Service 1 cleanup completed. Sep 24 20:40:10.775736 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-614375ac-edcc-4ee6-be09-5a49bd6e82a8 None None] Creating RPC server for service cinder-scheduler {{(pid=132381) start /opt/stack/cinder/cinder/service.py:238}} Sep 24 20:40:10.783304 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.service [None req-614375ac-edcc-4ee6-be09-5a49bd6e82a8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=132381) start /opt/stack/cinder/cinder/service.py:244}} Sep 24 20:40:12.734725 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-7836fbfb-f6d2-441c-8df6-99096707f344 None None] Received backup service update from ncdv-master-1: {'backend_state': False, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:40:14.976774 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-e862dc4b-24dc-4199-96d3-7974635a13e8 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:40:14.992066 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-e862dc4b-24dc-4199-96d3-7974635a13e8 None None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 24, 20, 40, 14, 949912)} {{(pid=132381) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 24 20:40:24.987174 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=24,cinder:INSERT=1 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:40:55.923305 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:41:05.912869 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.periodic_task [None req-1b771570-50f5-4fa9-baa9-4b0cda4d08b0 None None] Running periodic task SchedulerManager._clean_expired_messages {{(pid=132381) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Sep 24 20:41:05.918301 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-1b771570-50f5-4fa9-baa9-4b0cda4d08b0 None None] Deleted 0 expired messages. Sep 24 20:41:05.918734 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_service.periodic_task [None req-1b771570-50f5-4fa9-baa9-4b0cda4d08b0 None None] Running periodic task SchedulerManager._clean_expired_reservation {{(pid=132381) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Sep 24 20:41:25.931799 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=14,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:41:38.278066 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-7b6f4a19-fc75-40be-b472-99f8e7bd40d5 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:42:05.935428 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:42:07.794079 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-b5e9c558-8b9c-44cb-9b7c-67a7033af761 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:42:38.282620 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-8ca8d4d7-7981-4429-98c9-6b224c5b408b None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:42:45.939836 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:43:07.791361 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-01cd5279-ceb7-481e-87f1-97ae58dc4b40 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:43:15.952274 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:43:38.278661 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-4108aae2-3a91-4066-96fc-b503c369b01c None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:43:45.963420 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:44:07.794735 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-06bab5a5-ce5b-4926-b15c-cbb4aee4f176 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:44:15.971895 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:44:38.270683 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-d154f9d6-ff36-4274-a9a7-3b48a7d116d3 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:44:45.982591 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:45:07.791448 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-489a0b67-a744-455b-9019-2077b1901f6f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:45:25.990679 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:45:38.276561 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-e92ccb83-1451-43df-8579-80308af4055d None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:45:56.001703 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:46:07.790808 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-e3ba89ba-6da2-4383-83be-b17c93d72fd4 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:46:26.011183 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:46:38.268358 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-3f0c7060-cbb1-44cf-ae8e-6c2f553f52f5 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:47:06.014148 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:47:07.788171 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-4d6df3d1-0646-464e-b63a-df5935190209 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:47:36.023488 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:47:38.268293 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-ffbc8d36-c708-451d-8306-daccb09c8bbb None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:48:06.033770 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:48:07.791317 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-8297f2e6-6360-4021-85d3-da7adc406cfd None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:48:36.045335 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:48:38.270063 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-6e7c039c-e3b2-4094-bc2b-b473a1e4f1b3 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:49:06.055910 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:07.787687 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-709f55e7-8f3f-474d-a94a-2fdbd75bff92 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:49:36.073309 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:38.355450 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-15c4dfe7-22bc-4520-a17c-52eae59a6545 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:50:06.083737 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:07.793375 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-702c307a-03a5-41dc-b2fc-9ae755b86ff0 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:50:38.345994 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-884aebfb-da9f-449b-abd4-063c140d51ab None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:50:46.086396 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:07.796248 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-d372b2e8-677d-454a-85ca-0b13bda7d381 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:51:26.088660 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:38.404886 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-d19c7d74-9ce2-44b6-875c-2eb34ebf4e6d None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:52:06.095530 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:07.795464 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-95847075-6838-4c95-8550-8a8968b7e8e9 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:52:38.370200 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-b94c41c7-6e10-4053-bfc9-d7fe8217bd85 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:52:46.096655 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:07.811801 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-a849a28a-3c8a-4439-943f-4120818a5a3f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:53:26.094809 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:38.291340 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-e2057e4f-e109-4b7f-8a27-494728041903 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:53:56.006543 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Flow 'volume_create_scheduler' (9625187c-1641-4600-81fa-d7f32f399c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:53:56.028557 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (247d7086-94e3-4559-aed9-2d83dbb01d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:53:56.032506 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (247d7086-94e3-4559-aed9-2d83dbb01d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(3c6e1dda-a103-4e0d-b86a-6da231607ef6),volume_id=3c6e1dda-a103-4e0d-b86a-6da231607ef6,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:53:56.055707 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cc6fd255-c34b-49d8-b5c5-309346ea7d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:53:56.087164 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:53:56.116275 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:53:56.118387 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 24, 20, 53, 38, 283280)} {{(pid=132381) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 24 20:53:56.119050 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Starting with 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 20:53:56.119813 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:53:56.120361 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (3c6e1dda-a103-4e0d-b86a-6da231607ef6) {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Sep 24 20:53:56.120932 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Storage Capacity factors {'total_capacity': 19.94, 'free_capacity': 19.94, 'reserved_capacity': 0, 'total_reserved_available_capacity': 19.94, 'max_over_subscription_ratio': 20.0, 'total_available_capacity': 398.8, 'provisioned_capacity': 0, 'calculated_free_capacity': 398.8, 'virtual_free_capacity': 398.8, 'free_percent': 100.0, 'provisioned_ratio': 0.0, 'provisioned_type': 'thin'} {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Sep 24 20:53:56.121459 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 0, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 0, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:53:38.283280 {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:155}} Sep 24 20:53:56.121964 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/398.8 {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:186}} Sep 24 20:53:56.122461 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Filter CapacityFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:53:56.123019 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:53:56.123539 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filter_scheduler [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 0, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 0, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:53:38.283280] {{(pid=132381) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 24 20:53:56.124347 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_weight [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Weigher CapacityWeigher returned, weigher value is {max: 398.8, min: 398.8} {{(pid=132381) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 24 20:53:56.124865 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132381) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 24 20:53:56.125677 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filter_scheduler [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132381) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 24 20:53:56.126204 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:53:56.125841 {{(pid=132381) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 24 20:53:56.244389 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cc6fd255-c34b-49d8-b5c5-309346ea7d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:53:56.248656 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-454f6257-42e4-4a30-9cb6-26808237d937 tempest-LiveMigrationTest-471200620 None] Flow 'volume_create_scheduler' (9625187c-1641-4600-81fa-d7f32f399c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:54:07.808902 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-43bc819c-fbfc-49a5-8fdf-bfb3270b925f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:54:36.125440 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:38.420285 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-10869a67-27dc-4d86-8074-cdd51b186dd8 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 1, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:54:58.405586 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Flow 'volume_create_scheduler' (b252c7d6-dd13-438f-b8ea-d46d1fee83a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:54:58.411210 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5886e365-4411-4d7c-8f0e-c20c559003b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:54:58.415038 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5886e365-4411-4d7c-8f0e-c20c559003b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b1d57646-064a-4739-a13c-b954f6f5cb19),volume_id=b1d57646-064a-4739-a13c-b954f6f5cb19,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:54:58.418450 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e62b3f16-0ff4-4080-b342-4e4feb06314c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:54:58.428368 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:54:58.443865 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 1, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 24, 20, 54, 38, 414230)} {{(pid=132381) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 24 20:54:58.444385 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Starting with 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 20:54:58.444755 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:54:58.445117 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (b1d57646-064a-4739-a13c-b954f6f5cb19) {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Sep 24 20:54:58.445529 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Storage Capacity factors {'total_capacity': 19.94, 'free_capacity': 19.94, 'reserved_capacity': 0, 'total_reserved_available_capacity': 19.94, 'max_over_subscription_ratio': 20.0, 'total_available_capacity': 398.8, 'provisioned_capacity': 1, 'calculated_free_capacity': 397.8, 'virtual_free_capacity': 397.8, 'free_percent': 99.75, 'provisioned_ratio': 0.0, 'provisioned_type': 'thin'} {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Sep 24 20:54:58.446485 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:54:38.414230 {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:155}} Sep 24 20:54:58.446877 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/397.8 {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:186}} Sep 24 20:54:58.447224 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Filter CapacityFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:54:58.447610 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:54:58.447989 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filter_scheduler [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:54:38.414230] {{(pid=132381) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 24 20:54:58.448422 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_weight [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Weigher CapacityWeigher returned, weigher value is {max: 397.8, min: 397.8} {{(pid=132381) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 24 20:54:58.448770 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132381) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 24 20:54:58.449245 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filter_scheduler [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132381) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 24 20:54:58.449626 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 2, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:54:58.449271 {{(pid=132381) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 24 20:54:58.482705 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e62b3f16-0ff4-4080-b342-4e4feb06314c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:54:58.485879 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-24bee4ad-a01e-43c3-af20-2f2ecf8c64e4 tempest-LiveMigrationTest-471200620 None] Flow 'volume_create_scheduler' (b252c7d6-dd13-438f-b8ea-d46d1fee83a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:55:07.804194 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-37e654c2-558f-49ca-845d-7ccf9d328227 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:55:16.127426 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:38.396323 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-22e78ae5-c305-4bc5-8edb-70abfc93eb6a None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 20.03, 'free_capacity_gb': 19.65, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:55:56.129405 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:07.802698 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-152a58a3-37c0-4916-938a-225ba301c951 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:56:14.937549 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Flow 'volume_create_scheduler' (aee9d1aa-43ab-4275-a9e5-10558583453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:56:14.951172 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (74b8e6a2-f272-4fb4-9c50-b22b6479e9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:56:14.961245 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (74b8e6a2-f272-4fb4-9c50-b22b6479e9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f910cbdd-fbe4-4cac-bdb7-3b663c4f26d2),volume_id=f910cbdd-fbe4-4cac-bdb7-3b663c4f26d2,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:56:14.970984 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (438b84f0-ce6d-46ca-8514-abe29dce11bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:56:14.995191 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:56:15.022001 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 20.03, 'free_capacity_gb': 19.65, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 24, 20, 55, 38, 388437)} {{(pid=132381) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 24 20:56:15.022747 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Starting with 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 20:56:15.023276 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:56:15.023820 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (f910cbdd-fbe4-4cac-bdb7-3b663c4f26d2) {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Sep 24 20:56:15.024393 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Storage Capacity factors {'total_capacity': 20.03, 'free_capacity': 19.65, 'reserved_capacity': 0, 'total_reserved_available_capacity': 20.03, 'max_over_subscription_ratio': 20.0, 'total_available_capacity': 400.6, 'provisioned_capacity': 3, 'calculated_free_capacity': 397.6, 'virtual_free_capacity': 397.6, 'free_percent': 99.25, 'provisioned_ratio': 0.01, 'provisioned_type': 'thin'} {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Sep 24 20:56:15.024950 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.65, total_capacity_gb: 20.03, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:55:38.388437 {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:155}} Sep 24 20:56:15.025465 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/397.6 {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:186}} Sep 24 20:56:15.025971 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Filter CapacityFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:56:15.026810 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:56:15.027360 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filter_scheduler [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.65, total_capacity_gb: 20.03, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:55:38.388437] {{(pid=132381) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 24 20:56:15.027963 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_weight [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Weigher CapacityWeigher returned, weigher value is {max: 397.6, min: 397.6} {{(pid=132381) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 24 20:56:15.028473 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132381) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 24 20:56:15.029106 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filter_scheduler [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132381) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 24 20:56:15.029646 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.65, total_capacity_gb: 20.03, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:56:15.029286 {{(pid=132381) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 24 20:56:15.085569 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (438b84f0-ce6d-46ca-8514-abe29dce11bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:56:15.095305 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1f452070-e268-4ff9-a5e9-6786d26f3914 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Flow 'volume_create_scheduler' (aee9d1aa-43ab-4275-a9e5-10558583453e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:56:36.128078 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:56:36.746950 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Flow 'volume_create_scheduler' (f9173109-9cdf-4eec-b5cd-b6fe3909594e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:56:36.754929 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (711dcfbf-1c77-46d3-b71f-863d1b6d17a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:56:36.761159 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (711dcfbf-1c77-46d3-b71f-863d1b6d17a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(12570bdc-0c4e-4a84-9d49-0038138c72bb),volume_id=12570bdc-0c4e-4a84-9d49-0038138c72bb,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:56:36.766833 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ac6749f0-6702-4a43-8971-28dc9ed4ccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:56:36.780666 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:56:36.801894 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 20.03, 'free_capacity_gb': 19.65, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 24, 20, 55, 38, 388437)} {{(pid=132381) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 24 20:56:36.802636 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Starting with 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 20:56:36.803079 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:56:36.803525 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (12570bdc-0c4e-4a84-9d49-0038138c72bb) {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Sep 24 20:56:36.803855 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Storage Capacity factors {'total_capacity': 20.03, 'free_capacity': 18.65, 'reserved_capacity': 0, 'total_reserved_available_capacity': 20.03, 'max_over_subscription_ratio': 20.0, 'total_available_capacity': 400.6, 'provisioned_capacity': 4, 'calculated_free_capacity': 396.6, 'virtual_free_capacity': 396.6, 'free_percent': 99.0, 'provisioned_ratio': 0.01, 'provisioned_type': 'thin'} {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Sep 24 20:56:36.804293 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.65, total_capacity_gb: 20.03, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:56:15.029286 {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:155}} Sep 24 20:56:36.804655 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/396.6 {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:186}} Sep 24 20:56:36.805352 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Filter CapacityFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:56:36.806035 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:56:36.807031 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filter_scheduler [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.65, total_capacity_gb: 20.03, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:56:15.029286] {{(pid=132381) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 24 20:56:36.807356 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_weight [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Weigher CapacityWeigher returned, weigher value is {max: 396.6, min: 396.6} {{(pid=132381) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 24 20:56:36.807972 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132381) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 24 20:56:36.808680 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filter_scheduler [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132381) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 24 20:56:36.809073 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.65, total_capacity_gb: 20.03, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:56:36.808705 {{(pid=132381) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 24 20:56:36.857392 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ac6749f0-6702-4a43-8971-28dc9ed4ccf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:56:36.861038 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-18d4e270-1693-4c5e-a4d9-7875dbb4b50d tempest-ServersTestBootFromVolume-1605240856 None] Flow 'volume_create_scheduler' (f9173109-9cdf-4eec-b5cd-b6fe3909594e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:56:38.936687 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-418cf939-4e53-48d9-b89b-342d69ff214c None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.49, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 5, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:57:07.800174 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-95d3ddc1-8c05-4b22-9b69-c7a6b2f90f3e None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:57:09.553463 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:57:09.636855 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Flow 'volume_create_scheduler' (92737049-fdd5-4158-8781-01a6dbed82b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:57:09.645021 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (048c8782-3cf0-426c-bee6-a3d2bf343512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:57:09.653412 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (048c8782-3cf0-426c-bee6-a3d2bf343512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f054c8e1-9900-4dfe-8743-857b892350ae),volume_id=f054c8e1-9900-4dfe-8743-857b892350ae,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:57:09.656877 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (689d9307-3c6c-4f9e-9fd5-1d6df3bae4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:57:09.671671 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:57:09.709749 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.49, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 5, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 24, 20, 56, 38, 902039)} {{(pid=132381) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 24 20:57:09.712454 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Starting with 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 20:57:09.719936 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:57:09.720309 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (f054c8e1-9900-4dfe-8743-857b892350ae) {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Sep 24 20:57:09.720753 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Storage Capacity factors {'total_capacity': 19.94, 'free_capacity': 19.49, 'reserved_capacity': 0, 'total_reserved_available_capacity': 19.94, 'max_over_subscription_ratio': 20.0, 'total_available_capacity': 398.8, 'provisioned_capacity': 5, 'calculated_free_capacity': 393.8, 'virtual_free_capacity': 393.8, 'free_percent': 98.75, 'provisioned_ratio': 0.01, 'provisioned_type': 'thin'} {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Sep 24 20:57:09.721157 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.49, total_capacity_gb: 19.94, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:56:38.902039 {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:155}} Sep 24 20:57:09.722163 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/393.8 {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:186}} Sep 24 20:57:09.722524 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Filter CapacityFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:57:09.722927 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:57:09.723294 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filter_scheduler [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.49, total_capacity_gb: 19.94, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:56:38.902039] {{(pid=132381) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 24 20:57:09.723724 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_weight [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Weigher CapacityWeigher returned, weigher value is {max: 393.8, min: 393.8} {{(pid=132381) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 24 20:57:09.724067 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132381) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 24 20:57:09.724542 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filter_scheduler [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132381) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 24 20:57:09.724917 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.49, total_capacity_gb: 19.94, allocated_capacity_gb: 6, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 6, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:57:09.724565 {{(pid=132381) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 24 20:57:09.787120 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (689d9307-3c6c-4f9e-9fd5-1d6df3bae4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:57:09.795452 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Flow 'volume_create_scheduler' (92737049-fdd5-4158-8781-01a6dbed82b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:57:10.760290 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [req-34b6d407-41e8-44b4-8d7f-3b7be2cbfcce req-1c9fe1be-b35e-4385-ba38-9866a5bd9cd3 tempest-LiveMigrationTest-471200620 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.47, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 5, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:57:11.249669 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Flow 'volume_create_scheduler' (a886db25-07c0-4943-ae7d-96d0d00de39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:57:11.262459 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (69ad105d-b526-4861-ba6f-df10fa4ce2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:57:11.266584 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (69ad105d-b526-4861-ba6f-df10fa4ce2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f054c8e1-9900-4dfe-8743-857b892350ae),volume_id=f054c8e1-9900-4dfe-8743-857b892350ae,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:57:11.275302 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (139570a6-bc28-4a80-90ec-7a637cd2ea94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:57:11.289180 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.filter_scheduler [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Error scheduling f054c8e1-9900-4dfe-8743-857b892350ae from last vol-service: ncdv-master-1@ceph#ceph : ['Traceback (most recent call last):\n', ' File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 849, in create_cloned_volume\n src_volume.create_snap(clone_snap)\n', ' File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper\n', ' File "rbd.pyx", line 3514, in rbd.Image.create_snap\n', "rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-f054c8e1-9900-4dfe-8743-857b892350ae.clone_snap' from b'volume-a410930c-3d96-4d0b-b7f5-ee675704f604')\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 860, in create_cloned_volume\n src_volume.unprotect_snap(clone_snap)\n', ' File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper\n', ' File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap\n', "rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-a410930c-3d96-4d0b-b7f5-ee675704f604'@b'volume-f054c8e1-9900-4dfe-8743-857b892350ae.clone_snap')\n"] Sep 24 20:57:11.291263 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Consumed -1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.49, total_capacity_gb: 19.94, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:57:09.724565 {{(pid=132381) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 24 20:57:11.301187 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:57:11.314144 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.47, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 5, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 24, 20, 57, 10, 755094)} {{(pid=132381) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 24 20:57:11.315413 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Starting with 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 20:57:11.315698 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:57:11.316054 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (f054c8e1-9900-4dfe-8743-857b892350ae) {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Sep 24 20:57:11.316480 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Storage Capacity factors {'total_capacity': 19.93, 'free_capacity': 19.47, 'reserved_capacity': 0, 'total_reserved_available_capacity': 19.93, 'max_over_subscription_ratio': 20.0, 'total_available_capacity': 398.6, 'provisioned_capacity': 5, 'calculated_free_capacity': 393.6, 'virtual_free_capacity': 393.6, 'free_percent': 98.75, 'provisioned_ratio': 0.01, 'provisioned_type': 'thin'} {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Sep 24 20:57:11.316852 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.47, total_capacity_gb: 19.93, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:57:10.755094 {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:155}} Sep 24 20:57:11.325932 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/393.6 {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:186}} Sep 24 20:57:11.326432 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Filter CapacityFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:57:11.326880 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:57:11.327275 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filter_scheduler [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.47, total_capacity_gb: 19.93, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:57:10.755094] {{(pid=132381) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 24 20:57:11.327711 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_weight [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Weigher CapacityWeigher returned, weigher value is {max: 393.6, min: 393.6} {{(pid=132381) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 24 20:57:11.328070 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132381) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 24 20:57:11.328551 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filter_scheduler [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132381) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 24 20:57:11.328938 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.47, total_capacity_gb: 19.93, allocated_capacity_gb: 6, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 6, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:57:11.328576 {{(pid=132381) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 24 20:57:11.392838 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (139570a6-bc28-4a80-90ec-7a637cd2ea94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:57:11.398866 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Flow 'volume_create_scheduler' (a886db25-07c0-4943-ae7d-96d0d00de39f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:57:12.741869 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Flow 'volume_create_scheduler' (6179bafd-1a53-4cc0-bc0e-0c8f76f2f9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:57:12.762960 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f15ce329-7268-41cb-8819-52b8d186f3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:57:12.790828 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f15ce329-7268-41cb-8819-52b8d186f3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f054c8e1-9900-4dfe-8743-857b892350ae),volume_id=f054c8e1-9900-4dfe-8743-857b892350ae,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:57:12.810536 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7f41b517-bff7-4e86-b77d-90d32a78f046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:57:12.820946 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.filter_scheduler [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Error scheduling f054c8e1-9900-4dfe-8743-857b892350ae from last vol-service: ncdv-master-1@ceph#ceph : ['Traceback (most recent call last):\n', ' File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 849, in create_cloned_volume\n src_volume.create_snap(clone_snap)\n', ' File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper\n', ' File "rbd.pyx", line 3514, in rbd.Image.create_snap\n', "rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-f054c8e1-9900-4dfe-8743-857b892350ae.clone_snap' from b'volume-a410930c-3d96-4d0b-b7f5-ee675704f604')\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 860, in create_cloned_volume\n src_volume.unprotect_snap(clone_snap)\n', ' File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper\n', ' File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap\n', "rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-a410930c-3d96-4d0b-b7f5-ee675704f604'@b'volume-f054c8e1-9900-4dfe-8743-857b892350ae.clone_snap')\n"] Sep 24 20:57:12.828520 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Consumed -1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.47, total_capacity_gb: 19.93, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:57:11.328576 {{(pid=132381) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 24 20:57:12.843353 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:57:12.860827 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.47, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 5, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 24, 20, 57, 10, 755094)} {{(pid=132381) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 24 20:57:12.861419 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Starting with 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 20:57:12.864507 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:57:12.865059 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (f054c8e1-9900-4dfe-8743-857b892350ae) {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Sep 24 20:57:12.866732 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Storage Capacity factors {'total_capacity': 19.93, 'free_capacity': 19.47, 'reserved_capacity': 0, 'total_reserved_available_capacity': 19.93, 'max_over_subscription_ratio': 20.0, 'total_available_capacity': 398.6, 'provisioned_capacity': 5, 'calculated_free_capacity': 393.6, 'virtual_free_capacity': 393.6, 'free_percent': 98.75, 'provisioned_ratio': 0.01, 'provisioned_type': 'thin'} {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Sep 24 20:57:12.867426 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.47, total_capacity_gb: 19.93, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:57:11.328576 {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:155}} Sep 24 20:57:12.868576 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/393.6 {{(pid=132381) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:186}} Sep 24 20:57:12.871182 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Filter CapacityFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:57:12.873203 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:57:12.876874 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filter_scheduler [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.47, total_capacity_gb: 19.93, allocated_capacity_gb: 5, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:57:11.328576] {{(pid=132381) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 24 20:57:12.879880 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_weight [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Weigher CapacityWeigher returned, weigher value is {max: 393.6, min: 393.6} {{(pid=132381) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 24 20:57:12.881632 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132381) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 24 20:57:12.883043 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.filter_scheduler [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132381) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 24 20:57:12.886381 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.47, total_capacity_gb: 19.93, allocated_capacity_gb: 6, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 6, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-24 20:57:12.883618 {{(pid=132381) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 24 20:57:12.974309 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7f41b517-bff7-4e86-b77d-90d32a78f046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:57:12.981965 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Flow 'volume_create_scheduler' (6179bafd-1a53-4cc0-bc0e-0c8f76f2f9e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:57:13.339579 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-3ef70248-2e53-48c0-80b0-3d02bbd835f7 tempest-LiveMigrationTest-471200620 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.47, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 4, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:57:14.208470 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Flow 'volume_create_scheduler' (9747f213-7253-4e48-b940-d86f6d2220b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:57:14.223185 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d8e3e3e1-99db-42e1-a60d-6674a9263403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:57:14.258670 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d8e3e3e1-99db-42e1-a60d-6674a9263403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f054c8e1-9900-4dfe-8743-857b892350ae),volume_id=f054c8e1-9900-4dfe-8743-857b892350ae,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:57:14.269316 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (702b3636-f389-4d99-9953-acee9daee3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:57:14.274260 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.filter_scheduler [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Error scheduling f054c8e1-9900-4dfe-8743-857b892350ae from last vol-service: ncdv-master-1@ceph#ceph : ['Traceback (most recent call last):\n', ' File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 849, in create_cloned_volume\n src_volume.create_snap(clone_snap)\n', ' File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper\n', ' File "rbd.pyx", line 3514, in rbd.Image.create_snap\n', "rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-f054c8e1-9900-4dfe-8743-857b892350ae.clone_snap' from b'volume-a410930c-3d96-4d0b-b7f5-ee675704f604')\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 860, in create_cloned_volume\n src_volume.unprotect_snap(clone_snap)\n', ' File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper\n', ' File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap\n', "rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-a410930c-3d96-4d0b-b7f5-ee675704f604'@b'volume-f054c8e1-9900-4dfe-8743-857b892350ae.clone_snap')\n"] Sep 24 20:57:14.275481 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Creating message record for request_id = req-2616fa9d-1a93-4270-a7ac-b6177476605a Sep 24 20:57:14.297085 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:57:14.325175 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource f054c8e1-9900-4dfe-8743-857b892350ae: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource f054c8e1-9900-4dfe-8743-857b892350ae Sep 24 20:57:14.325885 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Setting Volume f054c8e1-9900-4dfe-8743-857b892350ae to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource f054c8e1-9900-4dfe-8743-857b892350ae {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 20:57:14.386924 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (702b3636-f389-4d99-9953-acee9daee3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:57:14.409840 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2616fa9d-1a93-4270-a7ac-b6177476605a tempest-TaggedBootDevicesTest-1987726953 None] Flow 'volume_create_scheduler' (9747f213-7253-4e48-b940-d86f6d2220b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:57:37.545426 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-5ac98736-90e0-4219-9daa-6a00dac0600a None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.47, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2e6e9886-13df-4b21-824b-dab0a721ddf9:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 24 20:57:46.131743 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=42,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:58:07.797931 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-4df242d8-d3f5-472f-8428-19c2146b7b22 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:58:26.131713 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:06.153151 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:59:07.801990 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-29a054f8-5242-4142-84b1-9f767ed67aad None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 20:59:14.553650 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Flow 'volume_create_scheduler' (c2b3876b-ed34-4ed9-ad4d-5d7d24d9b31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:59:14.557723 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (685d580d-afad-4736-bc69-60fb3851a40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:59:14.561735 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (685d580d-afad-4736-bc69-60fb3851a40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ca4e0764-d2db-49b8-ab27-51b0e2d286f5),volume_id=ca4e0764-d2db-49b8-ab27-51b0e2d286f5,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:59:14.567008 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ad6ea52d-287b-4c1c-b0e1-e464343d8463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:59:14.581873 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:59:14.598043 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 20:59:14.598697 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.host_manager [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Removing non-active backend: ncdv-master-1@ceph from scheduler cache. Sep 24 20:59:14.599243 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 20:59:14.599779 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:59:14.600311 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:59:14.600846 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:59:14.601374 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Filtering removed all hosts for the request with volume ID 'ca4e0764-d2db-49b8-ab27-51b0e2d286f5'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 20:59:14.601899 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Filtering removed all hosts for the request with volume ID 'ca4e0764-d2db-49b8-ab27-51b0e2d286f5'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 20:59:14.602731 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 20:59:14.603494 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Creating message record for request_id = req-2d85dfe1-d0b0-4267-841b-420e4ae34453 Sep 24 20:59:14.612791 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 20:59:14.613390 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Setting Volume ca4e0764-d2db-49b8-ab27-51b0e2d286f5 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 20:59:14.625944 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ad6ea52d-287b-4c1c-b0e1-e464343d8463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:59:14.630264 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2d85dfe1-d0b0-4267-841b-420e4ae34453 tempest-VolumesAdminNegativeTest-1782997698 None] Flow 'volume_create_scheduler' (c2b3876b-ed34-4ed9-ad4d-5d7d24d9b31f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:59:23.762260 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] Flow 'volume_create_scheduler' (2c74efba-eb6f-4087-9485-01d583e23edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:59:23.769901 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b6eec8da-9242-4488-852c-21f2825c5156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:59:23.777833 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b6eec8da-9242-4488-852c-21f2825c5156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(43ab6864-bf00-4096-9748-1ddea219385a),volume_id=43ab6864-bf00-4096-9748-1ddea219385a,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:59:23.788014 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (78aada25-d633-4a1b-b597-df0b8178e0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:59:23.803784 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:59:23.823515 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 20:59:23.823889 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 20:59:23.824251 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:59:23.824758 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:59:23.825268 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:59:23.825624 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] Filtering removed all hosts for the request with volume ID '43ab6864-bf00-4096-9748-1ddea219385a'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 20:59:23.825973 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] Filtering removed all hosts for the request with volume ID '43ab6864-bf00-4096-9748-1ddea219385a'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 20:59:23.826852 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 20:59:23.827480 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] Creating message record for request_id = req-7decff76-3944-4b3e-a42e-50db4d93864c Sep 24 20:59:23.839460 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 20:59:23.839865 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] Setting Volume 43ab6864-bf00-4096-9748-1ddea219385a to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 20:59:23.859758 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (78aada25-d633-4a1b-b597-df0b8178e0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:59:23.864941 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7decff76-3944-4b3e-a42e-50db4d93864c tempest-DeleteServersTestJSON-1814924671 None] Flow 'volume_create_scheduler' (2c74efba-eb6f-4087-9485-01d583e23edc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:59:32.996500 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] Flow 'volume_create_scheduler' (0f9ebfda-9738-4e71-bbbf-a6b1576420cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:59:33.004954 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d76039bd-5d05-48d2-83fb-fe37b4eccdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:59:33.011346 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d76039bd-5d05-48d2-83fb-fe37b4eccdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7d2ed1d8-1527-4544-8291-69b5c5832f6a),volume_id=7d2ed1d8-1527-4544-8291-69b5c5832f6a,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:59:33.017696 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (77df131f-fe5d-401c-9fa9-f2095408f217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 20:59:33.028620 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:59:33.068032 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 20:59:33.069784 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 20:59:33.070157 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:59:33.071923 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:59:33.072242 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 20:59:33.084072 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] Filtering removed all hosts for the request with volume ID '7d2ed1d8-1527-4544-8291-69b5c5832f6a'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 20:59:33.086013 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] Filtering removed all hosts for the request with volume ID '7d2ed1d8-1527-4544-8291-69b5c5832f6a'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 20:59:33.086870 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 20:59:33.087411 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] Creating message record for request_id = req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 Sep 24 20:59:33.101513 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 20:59:33.102637 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] Setting Volume 7d2ed1d8-1527-4544-8291-69b5c5832f6a to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 20:59:33.119372 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (77df131f-fe5d-401c-9fa9-f2095408f217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 20:59:33.134585 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d73f2950-828f-4e3e-bcd4-658ea9c2cca2 tempest-VolumesAdminNegativeTest-1782997698 None] Flow 'volume_create_scheduler' (0f9ebfda-9738-4e71-bbbf-a6b1576420cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 20:59:46.160489 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=46,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:00:07.799773 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-c3e9abb1-81dd-435e-b28b-3396b16aab05 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:00:26.177288 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:06.174135 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:01:07.798990 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-0ae32d40-396a-4ec1-9aef-e30ff21ed679 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:01:46.182621 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:07.796890 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-c5ceb009-2987-45e9-9867-003c16945f5b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:02:26.190621 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:02:56.213899 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:03:07.803794 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-5ace4e0e-c586-4c42-a320-99347c2d348b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:03:36.208246 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:07.808309 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-54702111-5775-405c-a20f-c8236339c5d8 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:04:16.209867 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:04:43.395897 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] Flow 'volume_create_scheduler' (2d9365fa-3290-4dab-b763-56634bc35a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:04:43.400316 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c1988976-8463-4f98-ae06-386fe5af6ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:04:43.404159 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c1988976-8463-4f98-ae06-386fe5af6ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(33e1e2f4-9452-428d-a9a6-2a7156ef684f),volume_id=33e1e2f4-9452-428d-a9a6-2a7156ef684f,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:04:43.407553 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ed853ba0-741e-466a-a108-595f298bb310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:04:43.416938 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:04:43.443591 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:04:43.444113 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:04:43.444597 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:04:43.445280 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:04:43.445766 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:04:43.446305 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] Filtering removed all hosts for the request with volume ID '33e1e2f4-9452-428d-a9a6-2a7156ef684f'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:04:43.446696 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] Filtering removed all hosts for the request with volume ID '33e1e2f4-9452-428d-a9a6-2a7156ef684f'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:04:43.447222 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:04:43.447655 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] Creating message record for request_id = req-e7c9578a-da6d-4923-b094-bd08ab70032b Sep 24 21:04:43.460108 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:04:43.460622 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] Setting Volume 33e1e2f4-9452-428d-a9a6-2a7156ef684f to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:04:43.470819 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ed853ba0-741e-466a-a108-595f298bb310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:04:43.473924 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e7c9578a-da6d-4923-b094-bd08ab70032b tempest-ServerRescueNegativeTestJSON-1027624478 None] Flow 'volume_create_scheduler' (2d9365fa-3290-4dab-b763-56634bc35a01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:04:44.927457 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] Flow 'volume_create_scheduler' (103d7727-333d-464b-8c85-4a6634119de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:04:44.943600 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5c80d8e6-da24-410c-b716-d18bd0a2df50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:04:44.953084 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5c80d8e6-da24-410c-b716-d18bd0a2df50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(31627d62-760c-4c21-be6b-8fb500b87cd0),volume_id=31627d62-760c-4c21-be6b-8fb500b87cd0,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:04:44.968918 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f30de4ca-9427-4cfb-8f76-561306228a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:04:44.998427 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:04:45.053198 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:04:45.053567 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:04:45.056087 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:04:45.056707 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:04:45.058281 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:04:45.061308 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] Filtering removed all hosts for the request with volume ID '31627d62-760c-4c21-be6b-8fb500b87cd0'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:04:45.061789 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] Filtering removed all hosts for the request with volume ID '31627d62-760c-4c21-be6b-8fb500b87cd0'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:04:45.062311 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:04:45.062844 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] Creating message record for request_id = req-722211a9-ad06-4553-ba80-2a1c6280f72c Sep 24 21:04:45.097229 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:04:45.097673 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] Setting Volume 31627d62-760c-4c21-be6b-8fb500b87cd0 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:04:45.121266 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f30de4ca-9427-4cfb-8f76-561306228a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:04:45.128842 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-722211a9-ad06-4553-ba80-2a1c6280f72c tempest-ServerRescueNegativeTestJSON-1027624478 None] Flow 'volume_create_scheduler' (103d7727-333d-464b-8c85-4a6634119de5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:04:56.220740 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=34,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:05:07.810580 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-48826093-54be-4fa9-95fb-b4972460114c None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:05:36.217970 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:07.804828 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-35d2135e-6be1-493e-974a-5f362e7697cd None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:06:16.215959 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:06:46.232010 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:07.807428 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-8ffb16a0-146a-4b9d-bda5-94839f878206 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:07:15.255524 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] Flow 'volume_create_scheduler' (5a873d1e-2997-4fff-8fba-a8df90342142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:07:15.260325 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ae2dce92-6e46-4891-a015-e09749505d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:07:15.264586 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ae2dce92-6e46-4891-a015-e09749505d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(07fe9aa1-c7b7-4759-8570-46c41937d187),volume_id=07fe9aa1-c7b7-4759-8570-46c41937d187,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:07:15.269745 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2b33ef64-2cb3-464e-8fc8-b1d473636b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:07:15.278102 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:07:15.294265 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:07:15.294834 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:07:15.295322 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:07:15.295869 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:07:15.296427 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:07:15.296986 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] Filtering removed all hosts for the request with volume ID '07fe9aa1-c7b7-4759-8570-46c41937d187'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:07:15.298185 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] Filtering removed all hosts for the request with volume ID '07fe9aa1-c7b7-4759-8570-46c41937d187'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:07:15.299363 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:07:15.300127 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] Creating message record for request_id = req-3432064c-31a0-4be4-81ba-07a432bcee36 Sep 24 21:07:15.308504 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:07:15.309182 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] Setting Volume 07fe9aa1-c7b7-4759-8570-46c41937d187 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:07:15.325051 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2b33ef64-2cb3-464e-8fc8-b1d473636b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:07:15.330045 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3432064c-31a0-4be4-81ba-07a432bcee36 tempest-AttachVolumeNegativeTest-1729429408 None] Flow 'volume_create_scheduler' (5a873d1e-2997-4fff-8fba-a8df90342142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:07:26.213978 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=6,cinder:SELECT=21,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:07:53.715070 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] Flow 'volume_create_scheduler' (0aed52aa-4043-4f61-8e42-6614852ad084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:07:53.730602 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (043a3692-9933-4ff0-9e7f-1393d3103644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:07:53.735328 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (043a3692-9933-4ff0-9e7f-1393d3103644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(376cbcf9-93ea-4854-b1cb-6683391e9744),volume_id=376cbcf9-93ea-4854-b1cb-6683391e9744,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:07:53.744383 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (69c2ed9a-0ad6-4802-a863-ea2f7053f2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:07:53.760056 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:07:53.790342 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:07:53.791103 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:07:53.791800 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:07:53.792357 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:07:53.792915 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:07:53.793713 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] Filtering removed all hosts for the request with volume ID '376cbcf9-93ea-4854-b1cb-6683391e9744'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:07:53.794307 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] Filtering removed all hosts for the request with volume ID '376cbcf9-93ea-4854-b1cb-6683391e9744'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:07:53.795034 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:07:53.795880 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] Creating message record for request_id = req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 Sep 24 21:07:53.806170 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:07:53.806640 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] Setting Volume 376cbcf9-93ea-4854-b1cb-6683391e9744 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:07:53.821306 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (69c2ed9a-0ad6-4802-a863-ea2f7053f2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:07:53.826059 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-2b3b360f-f1c2-45e0-9c8d-fafa6b0ddd80 tempest-AttachVolumeShelveTestJSON-809062567 None] Flow 'volume_create_scheduler' (0aed52aa-4043-4f61-8e42-6614852ad084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:07:56.234432 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:07.801485 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-d818caf3-adb9-4711-a551-58a85cb30a9a None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:08:36.234256 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:08:56.243078 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:02.089714 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] Flow 'volume_create_scheduler' (c64b530d-35a6-41f1-97b2-00c503bfe518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:09:02.095950 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e3ee1df9-5b18-4214-a567-30783d1886a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:09:02.100464 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e3ee1df9-5b18-4214-a567-30783d1886a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5e0d3797-d0b3-426d-847c-f4162357d70e),volume_id=5e0d3797-d0b3-426d-847c-f4162357d70e,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:09:02.104934 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1571479d-45a7-4447-94b8-7b50778bf59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:09:02.115524 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:09:02.133792 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:09:02.134546 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:09:02.136068 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:02.136768 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:02.137503 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:02.138199 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] Filtering removed all hosts for the request with volume ID '5e0d3797-d0b3-426d-847c-f4162357d70e'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:09:02.138884 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] Filtering removed all hosts for the request with volume ID '5e0d3797-d0b3-426d-847c-f4162357d70e'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:09:02.139678 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:09:02.140394 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] Creating message record for request_id = req-e5d79593-501e-418b-82a1-293f6a9644cd Sep 24 21:09:02.163825 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:09:02.163825 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] Setting Volume 5e0d3797-d0b3-426d-847c-f4162357d70e to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:09:02.176704 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1571479d-45a7-4447-94b8-7b50778bf59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:09:02.180020 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e5d79593-501e-418b-82a1-293f6a9644cd tempest-ServersNegativeTestJSON-1646194640 None] Flow 'volume_create_scheduler' (c64b530d-35a6-41f1-97b2-00c503bfe518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:09:04.508392 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] Flow 'volume_create_scheduler' (9afa62bd-3cd0-4331-b698-39061970f034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:09:04.527209 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a39153fa-c9ef-4762-9359-d4a0bf9f80a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:09:04.541029 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a39153fa-c9ef-4762-9359-d4a0bf9f80a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(23dbf1eb-c447-4ccf-8e47-7a981cd16716),volume_id=23dbf1eb-c447-4ccf-8e47-7a981cd16716,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:09:04.545399 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5453256d-e73e-4faf-821b-d251ad0a4039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:09:04.567774 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:09:04.599703 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:09:04.600091 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:09:04.600460 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:04.600822 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:04.601176 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:04.601532 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] Filtering removed all hosts for the request with volume ID '23dbf1eb-c447-4ccf-8e47-7a981cd16716'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:09:04.602040 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] Filtering removed all hosts for the request with volume ID '23dbf1eb-c447-4ccf-8e47-7a981cd16716'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:09:04.602561 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:09:04.603002 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] Creating message record for request_id = req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 Sep 24 21:09:04.619844 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:09:04.620556 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] Setting Volume 23dbf1eb-c447-4ccf-8e47-7a981cd16716 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:09:04.640392 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5453256d-e73e-4faf-821b-d251ad0a4039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:09:04.654254 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9f2ad8cf-1921-47bd-921d-ec06dde59c66 tempest-ServersNegativeTestJSON-1646194640 None] Flow 'volume_create_scheduler' (9afa62bd-3cd0-4331-b698-39061970f034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:09:07.810531 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-20df86e1-e442-4d84-a296-d83e4c0c44c6 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:09:09.688786 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] Flow 'volume_create_scheduler' (c0024bba-0ae5-4255-8a6e-9ee124316654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:09:09.701314 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (875ee0b9-ff0d-40a8-a516-4a9ec29fb4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:09:09.724713 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (875ee0b9-ff0d-40a8-a516-4a9ec29fb4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e7653e16-2454-457e-a1aa-4d5e54c74afe),volume_id=e7653e16-2454-457e-a1aa-4d5e54c74afe,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:09:09.730304 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f20ad414-b645-4d98-bc22-fdf775724640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:09:09.751276 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:09:09.783059 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:09:09.783423 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:09:09.783944 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:09.784475 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:09.785031 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:09.785373 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] Filtering removed all hosts for the request with volume ID 'e7653e16-2454-457e-a1aa-4d5e54c74afe'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:09:09.785884 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] Filtering removed all hosts for the request with volume ID 'e7653e16-2454-457e-a1aa-4d5e54c74afe'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:09:09.786549 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:09:09.787159 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] Creating message record for request_id = req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b Sep 24 21:09:09.794689 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:09:09.795311 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] Setting Volume e7653e16-2454-457e-a1aa-4d5e54c74afe to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:09:09.809420 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f20ad414-b645-4d98-bc22-fdf775724640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:09:09.813015 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-b7d5fa20-7715-45e4-be21-3f68a4e7b95b tempest-AttachVolumeNegativeTest-1729429408 None] Flow 'volume_create_scheduler' (c0024bba-0ae5-4255-8a6e-9ee124316654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:09:13.913023 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] Flow 'volume_create_scheduler' (def3264a-b659-4f08-bb88-f64600946c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:09:13.918403 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (137b32c7-9b62-4842-93ff-643068f8bbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:09:13.922996 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (137b32c7-9b62-4842-93ff-643068f8bbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9),volume_id=1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:09:13.926600 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5b4e6419-828c-4ca0-83b8-a05e2c2478a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:09:13.935984 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:09:13.951968 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:09:13.952511 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:09:13.953184 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:13.953547 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:13.953897 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:13.954250 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] Filtering removed all hosts for the request with volume ID '1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:09:13.954651 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] Filtering removed all hosts for the request with volume ID '1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:09:13.955136 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:09:13.955616 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] Creating message record for request_id = req-f5acdef2-b7ab-4679-992d-0647efc3372d Sep 24 21:09:13.967804 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:09:13.968416 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] Setting Volume 1d7eabde-cd37-4d6f-8c3b-66e3ceae6af9 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:09:13.984764 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5b4e6419-828c-4ca0-83b8-a05e2c2478a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:09:13.988610 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [req-f2923498-796e-465a-8127-ca76c7e9e16f req-f5acdef2-b7ab-4679-992d-0647efc3372d tempest-VolumesSnapshotsTestJSON-384710423 None] Flow 'volume_create_scheduler' (def3264a-b659-4f08-bb88-f64600946c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:09:36.248395 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=57,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:09:42.788001 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Flow 'volume_create_scheduler' (8a14418b-3c60-404f-8f6a-6170b0edb6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:09:42.792794 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d212380f-bb0e-4147-91e4-45f0693f4267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:09:42.821521 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d212380f-bb0e-4147-91e4-45f0693f4267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8c6d03ef-0212-4aa7-ae89-a57b4a8265e6),volume_id=8c6d03ef-0212-4aa7-ae89-a57b4a8265e6,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:09:42.839339 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ddb45796-639c-4911-8ffd-58dcdcaa3f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:09:42.853430 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:09:42.883012 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:09:42.883391 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:09:42.883757 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:42.884103 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:42.884545 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:42.884941 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Filtering removed all hosts for the request with volume ID '8c6d03ef-0212-4aa7-ae89-a57b4a8265e6'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:09:42.886069 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Filtering removed all hosts for the request with volume ID '8c6d03ef-0212-4aa7-ae89-a57b4a8265e6'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:09:42.886794 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:09:42.887547 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Creating message record for request_id = req-d734b6de-595c-4b92-8963-15dcf93f58b8 Sep 24 21:09:42.901423 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:09:42.903471 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Setting Volume 8c6d03ef-0212-4aa7-ae89-a57b4a8265e6 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:09:42.926451 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ddb45796-639c-4911-8ffd-58dcdcaa3f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:09:42.937619 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d734b6de-595c-4b92-8963-15dcf93f58b8 tempest-LiveAutoBlockMigrationV225Test-1717881295 None] Flow 'volume_create_scheduler' (8a14418b-3c60-404f-8f6a-6170b0edb6f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:09:47.201874 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] Flow 'volume_create_scheduler' (27c68800-5c79-4f2d-bbf4-ae1a7494680f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:09:47.216062 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (92dd363f-83af-46f1-be28-38ceb2596b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:09:47.220196 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (92dd363f-83af-46f1-be28-38ceb2596b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(627784a2-31e3-46d8-b41d-9b2692963422),volume_id=627784a2-31e3-46d8-b41d-9b2692963422,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:09:47.226936 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f4c1926b-c136-4c44-9b3e-8f80f4556b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:09:47.240399 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:09:47.255302 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:09:47.255667 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:09:47.256021 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:47.256372 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:47.256721 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:09:47.257069 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] Filtering removed all hosts for the request with volume ID '627784a2-31e3-46d8-b41d-9b2692963422'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:09:47.257457 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] Filtering removed all hosts for the request with volume ID '627784a2-31e3-46d8-b41d-9b2692963422'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:09:47.257885 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:09:47.258311 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] Creating message record for request_id = req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b Sep 24 21:09:47.269455 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:09:47.270422 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] Setting Volume 627784a2-31e3-46d8-b41d-9b2692963422 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:09:47.289827 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f4c1926b-c136-4c44-9b3e-8f80f4556b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:09:47.295135 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-25e1cd46-9184-4f6a-9042-a4e2fe11e86b tempest-AttachVolumeShelveTestJSON-809062567 None] Flow 'volume_create_scheduler' (27c68800-5c79-4f2d-bbf4-ae1a7494680f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:10:07.807569 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-1ab33a4d-4b90-4a5e-84b5-fe5b2aaa1cee None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:10:11.478372 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=34,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:10:11.578452 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] Flow 'volume_create_scheduler' (3ce52217-4a0c-4bc7-aa92-6245257b82e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:10:11.598012 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (de65c785-fca4-472c-8cac-9eab75e29bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:10:11.612047 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (de65c785-fca4-472c-8cac-9eab75e29bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9f39f3bf-3e61-45b5-9b22-e69f5ac93a32),volume_id=9f39f3bf-3e61-45b5-9b22-e69f5ac93a32,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:10:11.625311 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1b714514-cd6b-4475-9e25-6e7e9e0e6f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:10:11.670055 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:10:11.711658 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:10:11.713176 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:10:11.714021 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:10:11.715432 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:10:11.716665 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:10:11.717635 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] Filtering removed all hosts for the request with volume ID '9f39f3bf-3e61-45b5-9b22-e69f5ac93a32'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:10:11.718458 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] Filtering removed all hosts for the request with volume ID '9f39f3bf-3e61-45b5-9b22-e69f5ac93a32'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:10:11.719485 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:10:11.721916 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] Creating message record for request_id = req-891b73ed-6375-4e28-928f-330c2fccf961 Sep 24 21:10:11.745501 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:10:11.746174 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] Setting Volume 9f39f3bf-3e61-45b5-9b22-e69f5ac93a32 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:10:11.767635 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1b714514-cd6b-4475-9e25-6e7e9e0e6f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:10:11.771657 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [req-d406d1e6-d6c4-4b3d-af3b-89f1f8f3a76c req-891b73ed-6375-4e28-928f-330c2fccf961 tempest-VolumesGetTestJSON-461793596 None] Flow 'volume_create_scheduler' (3ce52217-4a0c-4bc7-aa92-6245257b82e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:10:40.763282 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] Flow 'volume_create_scheduler' (8b106ae6-d773-48ff-91dd-e49565e1cf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:10:40.768763 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2e07cb12-1ad6-4092-a3fe-66b5c1b4fe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:10:40.776444 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2e07cb12-1ad6-4092-a3fe-66b5c1b4fe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c6f3098e-a68e-49ad-ac97-41633661eec6),volume_id=c6f3098e-a68e-49ad-ac97-41633661eec6,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:10:40.780298 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b25ca1b5-5363-4d2b-9790-146ff8a68525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:10:40.791214 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:10:40.811273 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:10:40.811862 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:10:40.812362 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:10:40.813523 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:10:40.831028 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:10:40.831434 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] Filtering removed all hosts for the request with volume ID 'c6f3098e-a68e-49ad-ac97-41633661eec6'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:10:40.831789 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] Filtering removed all hosts for the request with volume ID 'c6f3098e-a68e-49ad-ac97-41633661eec6'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:10:40.832403 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:10:40.832834 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] Creating message record for request_id = req-87652ee9-a389-43a1-9e25-e0db74cf099b Sep 24 21:10:40.844278 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:10:40.845127 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] Setting Volume c6f3098e-a68e-49ad-ac97-41633661eec6 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:10:40.858992 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b25ca1b5-5363-4d2b-9790-146ff8a68525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:10:40.863595 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-87652ee9-a389-43a1-9e25-e0db74cf099b tempest-VolumesTestJSON-2083950098 None] Flow 'volume_create_scheduler' (8b106ae6-d773-48ff-91dd-e49565e1cf89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:10:42.364043 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=31,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=2 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:10:42.457673 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] Flow 'volume_create_scheduler' (33ac25c2-c406-4c24-bd82-062ec6455efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:10:42.467787 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (365ac6b6-8c88-4f1d-a2c2-a814542f3f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:10:42.484430 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (365ac6b6-8c88-4f1d-a2c2-a814542f3f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(35108d02-a060-45b7-b1e7-b791bcfe2c81),volume_id=35108d02-a060-45b7-b1e7-b791bcfe2c81,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:10:42.496021 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (154b29d5-35c7-4b7c-b225-b68a5be5b0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:10:42.528702 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:10:42.560559 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:10:42.561192 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:10:42.562827 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:10:42.563318 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:10:42.563764 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:10:42.570880 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] Filtering removed all hosts for the request with volume ID '35108d02-a060-45b7-b1e7-b791bcfe2c81'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:10:42.571601 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] Filtering removed all hosts for the request with volume ID '35108d02-a060-45b7-b1e7-b791bcfe2c81'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:10:42.572338 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:10:42.573029 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] Creating message record for request_id = req-d835e034-dd13-44bc-a851-a6ca1841aee8 Sep 24 21:10:42.585221 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:10:42.585798 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] Setting Volume 35108d02-a060-45b7-b1e7-b791bcfe2c81 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:10:42.607067 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (154b29d5-35c7-4b7c-b225-b68a5be5b0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:10:42.614995 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d835e034-dd13-44bc-a851-a6ca1841aee8 tempest-AttachVolumeNegativeTest-1729429408 None] Flow 'volume_create_scheduler' (33ac25c2-c406-4c24-bd82-062ec6455efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:11:07.813249 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-7a4c2ead-603a-423a-ac4e-1b9c72bf9e78 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:11:16.258548 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:11:56.270218 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:11:57.737886 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-a31f2737-d50a-41b0-885f-8f95fda341d0 tempest-VolumePoolsAdminTestsJSON-478555094 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:11:57.811679 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-7f1dcd00-db9f-47b8-ba5c-b916e3300d89 tempest-VolumePoolsAdminTestsJSON-478555094 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:12:06.951146 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-9f1743cc-f333-439c-87e0-bedba888643a tempest-GroupSnapshotsV319Test-72725943 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:12:06.964121 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-9f1743cc-f333-439c-87e0-bedba888643a tempest-GroupSnapshotsV319Test-72725943 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:12:06.964999 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.manager [None req-9f1743cc-f333-439c-87e0-bedba888643a tempest-GroupSnapshotsV319Test-72725943 None] Could not find a backend for group 590c7ff8-5525-4634-b9dc-2c70cb9169eb.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:12:07.809015 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-1a58175b-b109-437e-aeef-1416839f4166 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:12:33.287844 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=21,cinder:UPDATE=5 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:12:33.409770 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] Flow 'volume_create_scheduler' (01cd6520-b05c-4595-b779-d9e3fecef398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:12:33.449902 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6891eff7-81ae-4ead-9ef3-2edabc0f5cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:12:33.466890 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6891eff7-81ae-4ead-9ef3-2edabc0f5cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(dcf7d960-ecf2-4676-a342-def79509be8c),volume_id=dcf7d960-ecf2-4676-a342-def79509be8c,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:12:33.482904 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (88c8c135-27e2-4c2c-a374-2ca43ed1489e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:12:33.510993 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:12:33.545617 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:12:33.546166 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:12:33.546939 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:12:33.547201 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:12:33.547659 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:12:33.548140 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] Filtering removed all hosts for the request with volume ID 'dcf7d960-ecf2-4676-a342-def79509be8c'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:12:33.548612 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] Filtering removed all hosts for the request with volume ID 'dcf7d960-ecf2-4676-a342-def79509be8c'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:12:33.549472 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:12:33.551017 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] Creating message record for request_id = req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc Sep 24 21:12:33.569834 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:12:33.570355 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] Setting Volume dcf7d960-ecf2-4676-a342-def79509be8c to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:12:33.586856 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (88c8c135-27e2-4c2c-a374-2ca43ed1489e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:12:33.591802 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-a81cbcb1-bb17-48e1-a8f3-e7a7e2159bdc tempest-VolumesListAdminTestJSON-1559547526 None] Flow 'volume_create_scheduler' (01cd6520-b05c-4595-b779-d9e3fecef398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:12:37.175733 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] Flow 'volume_create_scheduler' (97e8be42-4a1d-459f-8c54-b99b32f32c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:12:37.187942 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (27d62a48-450c-4082-b478-2e3a6a086fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:12:37.201036 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (27d62a48-450c-4082-b478-2e3a6a086fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(46eb9445-bcde-4ff0-aa85-071cb31ef731),volume_id=46eb9445-bcde-4ff0-aa85-071cb31ef731,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:12:37.201036 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e1aa1775-b29c-4123-9bac-ea03fb98f01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:12:37.205120 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:12:37.219698 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:12:37.220075 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:12:37.221073 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:12:37.221349 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:12:37.221734 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:12:37.226764 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] Filtering removed all hosts for the request with volume ID '46eb9445-bcde-4ff0-aa85-071cb31ef731'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:12:37.226764 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] Filtering removed all hosts for the request with volume ID '46eb9445-bcde-4ff0-aa85-071cb31ef731'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:12:37.226764 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:12:37.226764 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] Creating message record for request_id = req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea Sep 24 21:12:37.231879 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:12:37.232262 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] Setting Volume 46eb9445-bcde-4ff0-aa85-071cb31ef731 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:12:37.248061 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e1aa1775-b29c-4123-9bac-ea03fb98f01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:12:37.252972 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-8fbd93ae-ec25-43d6-955a-07cbd1f778ea tempest-VolumesServicesTestJSON-2035970468 None] Flow 'volume_create_scheduler' (97e8be42-4a1d-459f-8c54-b99b32f32c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:12:42.835186 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] Flow 'volume_create_scheduler' (62dea37f-1c4c-4b99-a708-d03f9ac40549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:12:42.858283 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (07f04ca7-a466-4487-985e-7a0752cd2c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:12:42.877360 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (07f04ca7-a466-4487-985e-7a0752cd2c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(3d49ab87-a156-469d-b511-5bc22afef24d),volume_id=3d49ab87-a156-469d-b511-5bc22afef24d,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:12:42.879312 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f539ccae-8250-4cbc-b7b9-37304c72601f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:12:42.893294 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:12:42.929730 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:12:42.930102 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:12:42.930455 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:12:42.930848 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:12:42.931197 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:12:42.931540 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] Filtering removed all hosts for the request with volume ID '3d49ab87-a156-469d-b511-5bc22afef24d'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:12:42.931880 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] Filtering removed all hosts for the request with volume ID '3d49ab87-a156-469d-b511-5bc22afef24d'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:12:42.932364 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:12:42.935733 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] Creating message record for request_id = req-af835270-f61c-4754-808f-88a5e2970772 Sep 24 21:12:42.955135 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:12:42.955789 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] Setting Volume 3d49ab87-a156-469d-b511-5bc22afef24d to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:12:42.982656 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f539ccae-8250-4cbc-b7b9-37304c72601f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:12:42.990162 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-af835270-f61c-4754-808f-88a5e2970772 tempest-VolumesListTestJSON-973352175 None] Flow 'volume_create_scheduler' (62dea37f-1c4c-4b99-a708-d03f9ac40549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:12:47.099472 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] Flow 'volume_create_scheduler' (2efe11dc-5f30-4298-b827-46c6c132e36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:12:47.104682 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (175a5a77-eea0-4cb3-89c9-16249cbeeef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:12:47.115606 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (175a5a77-eea0-4cb3-89c9-16249cbeeef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b583a0a5-0cea-4c23-b019-3d2207c95f90),volume_id=b583a0a5-0cea-4c23-b019-3d2207c95f90,volume_properties=VolumeProperties,volume_type=VolumeType(d33b9224-d52e-42ce-be97-c1e0d2e0eace))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:12:47.123101 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5cbe382e-8027-4489-b25c-64f7fd50beec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:12:47.143520 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:12:47.208911 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:12:47.209293 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:12:47.209655 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:12:47.210008 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:12:47.210357 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:12:47.210728 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] Filtering removed all hosts for the request with volume ID 'b583a0a5-0cea-4c23-b019-3d2207c95f90'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:12:47.214635 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] Filtering removed all hosts for the request with volume ID 'b583a0a5-0cea-4c23-b019-3d2207c95f90'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:12:47.215172 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] No weighed backend found for volume with properties: {'id': 'd33b9224-d52e-42ce-be97-c1e0d2e0eace', 'name': 'tempest-VolumeTypesAccessTest-volume-type-1603305209', 'description': None, 'is_public': False, 'projects': [], 'extra_specs': {}, 'qos_specs_id': None, 'created_at': '2022-09-24T21:12:46.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:12:47.215621 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] Creating message record for request_id = req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 Sep 24 21:12:47.236755 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:12:47.237171 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] Setting Volume b583a0a5-0cea-4c23-b019-3d2207c95f90 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:12:47.250018 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5cbe382e-8027-4489-b25c-64f7fd50beec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:12:47.254245 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-67dd32ae-1f40-4c3e-a5e9-a6707f1710a5 tempest-VolumeTypesAccessTest-1912392107 None] Flow 'volume_create_scheduler' (2efe11dc-5f30-4298-b827-46c6c132e36a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:12:48.937214 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] Flow 'volume_create_scheduler' (bc8cc0ec-4024-4c77-9012-6fdad858ed91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:12:48.941927 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fd62f438-8128-472f-be39-f89cbc56c165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:12:48.946815 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fd62f438-8128-472f-be39-f89cbc56c165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(30c01ebb-e787-4c05-a55f-3e79989606e4),volume_id=30c01ebb-e787-4c05-a55f-3e79989606e4,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:12:48.954103 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e156c458-3c0f-4b9e-b067-03f859a4cfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:12:48.966432 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:12:49.004064 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:12:49.004453 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:12:49.005690 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:12:49.006058 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:12:49.006413 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:12:49.009333 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] Filtering removed all hosts for the request with volume ID '30c01ebb-e787-4c05-a55f-3e79989606e4'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:12:49.009736 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] Filtering removed all hosts for the request with volume ID '30c01ebb-e787-4c05-a55f-3e79989606e4'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:12:49.010812 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:12:49.011260 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] Creating message record for request_id = req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e Sep 24 21:12:49.029580 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:12:49.030245 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] Setting Volume 30c01ebb-e787-4c05-a55f-3e79989606e4 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:12:49.057194 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e156c458-3c0f-4b9e-b067-03f859a4cfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:12:49.062962 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1596ba92-1ed2-45eb-8c88-e33b1d6fa41e tempest-VolumesSnapshotListTestJSON-768791757 None] Flow 'volume_create_scheduler' (bc8cc0ec-4024-4c77-9012-6fdad858ed91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:02.877051 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] Flow 'volume_create_scheduler' (3928ebfe-beef-4ac1-9966-968fcc37538b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:02.884277 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (95c2874b-4172-46d6-909b-c0da5e5b960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:02.889944 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (95c2874b-4172-46d6-909b-c0da5e5b960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f70cf436-0ad7-4abb-b53c-710fa389ca92),volume_id=f70cf436-0ad7-4abb-b53c-710fa389ca92,volume_properties=VolumeProperties,volume_type=VolumeType(21878432-b0ec-46ff-afa2-fc9a44af03ac))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:02.896797 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (152168da-b67c-4f21-b817-e0e679f6174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:02.911286 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:13:02.935972 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:13:02.936874 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:13:02.937666 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:02.938513 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:02.939270 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:02.939904 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] Filtering removed all hosts for the request with volume ID 'f70cf436-0ad7-4abb-b53c-710fa389ca92'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:13:02.940481 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] Filtering removed all hosts for the request with volume ID 'f70cf436-0ad7-4abb-b53c-710fa389ca92'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:13:02.941427 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] No weighed backend found for volume with properties: {'id': '21878432-b0ec-46ff-afa2-fc9a44af03ac', 'name': 'tempest-UserMessagesTest-volume-type-1160667490', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'storage_protocol': 'tempest-storage_protocol-1416012795', 'vendor_name': 'tempest-vendor_name-881688321'}, 'qos_specs_id': None, 'created_at': '2022-09-24T21:13:02.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:13:02.942366 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] Creating message record for request_id = req-3adef63c-15e0-4b5a-892c-97f7c07e2acf Sep 24 21:13:02.956578 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:13:02.957070 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] Setting Volume f70cf436-0ad7-4abb-b53c-710fa389ca92 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:13:02.972717 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (152168da-b67c-4f21-b817-e0e679f6174d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:02.978073 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3adef63c-15e0-4b5a-892c-97f7c07e2acf tempest-UserMessagesTest-2010532864 None] Flow 'volume_create_scheduler' (3928ebfe-beef-4ac1-9966-968fcc37538b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:02.984255 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=74,cinder:UPDATE=15,cinder:INSERT=6,cinder:DELETE=5 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:13:04.695217 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] Flow 'volume_create_scheduler' (76dd8e21-0a15-445e-bfc7-3f5cc85caa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:04.712619 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6e4f43bc-70c2-47ed-acea-36cf331c261f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:04.717108 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6e4f43bc-70c2-47ed-acea-36cf331c261f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(52781838-2750-4223-a36a-fee8339d4af1),volume_id=52781838-2750-4223-a36a-fee8339d4af1,volume_properties=VolumeProperties,volume_type=VolumeType(7ef4f229-d6a0-4e6e-91e1-3900bc4af010))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:04.723268 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b86f855a-150b-4cfa-9032-5231d0bc63c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:04.749853 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:13:04.780855 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:13:04.781235 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:13:04.782276 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:04.782699 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:04.783450 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:04.784119 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] Filtering removed all hosts for the request with volume ID '52781838-2750-4223-a36a-fee8339d4af1'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:13:04.785230 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] Filtering removed all hosts for the request with volume ID '52781838-2750-4223-a36a-fee8339d4af1'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:13:04.786456 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] No weighed backend found for volume with properties: {'id': '7ef4f229-d6a0-4e6e-91e1-3900bc4af010', 'name': 'tempest-UserMessagesTest-volume-type-1690467629', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'storage_protocol': 'tempest-storage_protocol-2073974118', 'vendor_name': 'tempest-vendor_name-1867762808'}, 'qos_specs_id': None, 'created_at': '2022-09-24T21:13:04.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:13:04.787172 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] Creating message record for request_id = req-57d13477-c663-4009-9228-7ed5ea95d614 Sep 24 21:13:04.802056 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:13:04.804646 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] Setting Volume 52781838-2750-4223-a36a-fee8339d4af1 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:13:04.824898 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b86f855a-150b-4cfa-9032-5231d0bc63c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:04.829695 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-57d13477-c663-4009-9228-7ed5ea95d614 tempest-UserMessagesTest-2010532864 None] Flow 'volume_create_scheduler' (76dd8e21-0a15-445e-bfc7-3f5cc85caa49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:07.809912 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-1a6f8940-21b5-4b6f-a47a-76606db022c1 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:13:22.051283 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] Flow 'volume_create_scheduler' (261ee7ec-5b31-4ed3-ad9f-b9ae823c3fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:22.068280 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (34fbfd46-9418-417c-9892-6e03701418db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:22.086530 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (34fbfd46-9418-417c-9892-6e03701418db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e777bbb6-d61b-4585-b157-9ba6dd3ebeb3),volume_id=e777bbb6-d61b-4585-b157-9ba6dd3ebeb3,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:22.090705 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7a8606b4-1e43-4f2b-949e-619ed3345882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:22.099052 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:13:22.125857 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:13:22.130102 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:13:22.130650 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:22.130971 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:22.131707 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:22.132145 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] Filtering removed all hosts for the request with volume ID 'e777bbb6-d61b-4585-b157-9ba6dd3ebeb3'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:13:22.134305 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] Filtering removed all hosts for the request with volume ID 'e777bbb6-d61b-4585-b157-9ba6dd3ebeb3'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:13:22.134872 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:13:22.139265 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] Creating message record for request_id = req-0589442c-0565-4578-afe2-2462ca53b6d2 Sep 24 21:13:22.158512 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:13:22.158976 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] Setting Volume e777bbb6-d61b-4585-b157-9ba6dd3ebeb3 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:13:22.170679 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7a8606b4-1e43-4f2b-949e-619ed3345882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:22.175152 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-0589442c-0565-4578-afe2-2462ca53b6d2 tempest-VolumesImageMetadata-134135727 None] Flow 'volume_create_scheduler' (261ee7ec-5b31-4ed3-ad9f-b9ae823c3fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:29.674456 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] Flow 'volume_create_scheduler' (6d61bca6-03ec-42fe-b12f-1e679dacb4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:29.678689 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e757e12a-67b8-475e-a00e-d99d304322e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:29.682585 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e757e12a-67b8-475e-a00e-d99d304322e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(84e602da-0c7b-4ba2-8ff0-f247c9b56e24),volume_id=84e602da-0c7b-4ba2-8ff0-f247c9b56e24,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:29.687097 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (331c14a1-c197-434f-bd08-dfb997e366e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:29.696871 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:13:29.711916 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:13:29.712560 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:13:29.713092 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:29.713602 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:29.714116 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:29.714676 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] Filtering removed all hosts for the request with volume ID '84e602da-0c7b-4ba2-8ff0-f247c9b56e24'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:13:29.715176 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] Filtering removed all hosts for the request with volume ID '84e602da-0c7b-4ba2-8ff0-f247c9b56e24'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:13:29.715836 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:13:29.716428 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] Creating message record for request_id = req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca Sep 24 21:13:29.726217 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:13:29.727071 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] Setting Volume 84e602da-0c7b-4ba2-8ff0-f247c9b56e24 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:13:29.740886 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (331c14a1-c197-434f-bd08-dfb997e366e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:29.745641 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7ffdda13-17cd-4d18-b0c4-7d6a5f5577ca tempest-VolumesTransfersV357Test-1924036757 None] Flow 'volume_create_scheduler' (6d61bca6-03ec-42fe-b12f-1e679dacb4ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:30.107861 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] Flow 'volume_create_scheduler' (a3da27d0-b4dd-41cf-92f9-d1663cc5e960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:30.130237 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4788d96d-5a84-45bd-bce9-633e79690b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:30.143398 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4788d96d-5a84-45bd-bce9-633e79690b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bbcb482e-4edb-48b7-afeb-35a43e5e61c1),volume_id=bbcb482e-4edb-48b7-afeb-35a43e5e61c1,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:30.146904 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a1a6882e-20a0-4dfb-a1c1-3469a22b0d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:30.163292 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:13:30.203691 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:13:30.204279 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:13:30.205929 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:30.206234 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:30.206611 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:30.208223 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] Filtering removed all hosts for the request with volume ID 'bbcb482e-4edb-48b7-afeb-35a43e5e61c1'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:13:30.208602 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] Filtering removed all hosts for the request with volume ID 'bbcb482e-4edb-48b7-afeb-35a43e5e61c1'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:13:30.209122 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:13:30.209740 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] Creating message record for request_id = req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 Sep 24 21:13:30.221052 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:13:30.221309 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] Setting Volume bbcb482e-4edb-48b7-afeb-35a43e5e61c1 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:13:30.242064 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a1a6882e-20a0-4dfb-a1c1-3469a22b0d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:30.245635 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6f94beb1-eb30-4db9-86d0-ac77bfcf3ef7 tempest-TestVolumeBackupRestore-1063000236 None] Flow 'volume_create_scheduler' (a3da27d0-b4dd-41cf-92f9-d1663cc5e960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:31.509619 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] Flow 'volume_create_scheduler' (90b591a0-4114-478b-bd11-0cf3c268af14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:31.524401 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ab6a7226-4b90-4cc7-ab1c-7da6a52b87b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:31.532987 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ab6a7226-4b90-4cc7-ab1c-7da6a52b87b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c349a4f0-db55-4957-bdcc-f32f0be65b9d),volume_id=c349a4f0-db55-4957-bdcc-f32f0be65b9d,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:31.546745 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f31dd74d-4ef7-42f9-8a32-3c6ab7376d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:31.563405 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:13:31.601698 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:13:31.602393 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:13:31.602942 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:31.603461 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:31.604099 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:31.604604 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] Filtering removed all hosts for the request with volume ID 'c349a4f0-db55-4957-bdcc-f32f0be65b9d'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:13:31.605356 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] Filtering removed all hosts for the request with volume ID 'c349a4f0-db55-4957-bdcc-f32f0be65b9d'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:13:31.612385 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:13:31.613921 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] Creating message record for request_id = req-126afa30-cc2f-48d4-81ca-cbe97338c4fb Sep 24 21:13:31.632186 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:13:31.632186 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] Setting Volume c349a4f0-db55-4957-bdcc-f32f0be65b9d to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:13:31.671444 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f31dd74d-4ef7-42f9-8a32-3c6ab7376d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:31.678026 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-126afa30-cc2f-48d4-81ca-cbe97338c4fb tempest-VolumesTransfersV357Test-1924036757 None] Flow 'volume_create_scheduler' (90b591a0-4114-478b-bd11-0cf3c268af14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:36.301019 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:DELETE=6,cinder:SELECT=65,cinder:UPDATE=13,cinder:INSERT=5 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:13:41.606086 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] Flow 'volume_create_scheduler' (066c2004-d852-450c-843f-856a537c0866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:41.622076 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6e76589d-1bfc-4b00-8cf9-f22a7db6e593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:41.629264 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6e76589d-1bfc-4b00-8cf9-f22a7db6e593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a30e152d-6c40-4e99-b63a-14701b422fe9),volume_id=a30e152d-6c40-4e99-b63a-14701b422fe9,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:41.646717 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6d9d7bf6-a484-4057-88c0-e478b2f00f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:41.662040 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:13:41.692587 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:13:41.695627 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:13:41.696180 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:41.696759 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:41.697271 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:41.697532 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] Filtering removed all hosts for the request with volume ID 'a30e152d-6c40-4e99-b63a-14701b422fe9'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:13:41.697884 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] Filtering removed all hosts for the request with volume ID 'a30e152d-6c40-4e99-b63a-14701b422fe9'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:13:41.698394 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:13:41.711101 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] Creating message record for request_id = req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 Sep 24 21:13:41.726064 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:13:41.726560 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] Setting Volume a30e152d-6c40-4e99-b63a-14701b422fe9 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:13:41.756694 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6d9d7bf6-a484-4057-88c0-e478b2f00f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:41.760457 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-bcddfb8a-ecbe-4b96-b737-4d579baa79c1 tempest-VolumesBackupsTest-1139075738 None] Flow 'volume_create_scheduler' (066c2004-d852-450c-843f-856a537c0866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:43.386097 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] Flow 'volume_create_scheduler' (200bb2c3-9ff5-49f0-9de1-e092d1930b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:43.392937 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3726dc96-239a-43b8-9819-b0c8e35160bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:43.399103 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3726dc96-239a-43b8-9819-b0c8e35160bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4e28cf41-fe1f-4d95-8657-17a87c19c926),volume_id=4e28cf41-fe1f-4d95-8657-17a87c19c926,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:43.403829 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4998c8be-a5b7-43ce-bdc8-faed526536b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:43.414908 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:13:43.432276 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:13:43.432932 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:13:43.433474 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:43.434003 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:43.434548 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:43.435475 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] Filtering removed all hosts for the request with volume ID '4e28cf41-fe1f-4d95-8657-17a87c19c926'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:13:43.436222 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] Filtering removed all hosts for the request with volume ID '4e28cf41-fe1f-4d95-8657-17a87c19c926'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:13:43.436905 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:13:43.437993 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] Creating message record for request_id = req-bf54597c-3f9f-4745-aa0e-f90769d7171d Sep 24 21:13:43.452907 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:13:43.453528 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] Setting Volume 4e28cf41-fe1f-4d95-8657-17a87c19c926 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:13:43.481464 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4998c8be-a5b7-43ce-bdc8-faed526536b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:43.484886 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-bf54597c-3f9f-4745-aa0e-f90769d7171d tempest-VolumesBackupsTest-1139075738 None] Flow 'volume_create_scheduler' (200bb2c3-9ff5-49f0-9de1-e092d1930b2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:48.379494 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] Flow 'volume_create_scheduler' (7c936a13-f269-4cf6-8003-a574a15eefb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:48.383828 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (773eab4d-af7a-46dd-a9b9-60c97c2c3543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:48.387986 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (773eab4d-af7a-46dd-a9b9-60c97c2c3543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(135aca05-7e04-45cf-adfe-3297def1f0a1),volume_id=135aca05-7e04-45cf-adfe-3297def1f0a1,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:48.392465 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (00b0aed6-44f0-4b38-828e-d80703320f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:48.400921 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:13:48.419479 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:13:48.421071 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:13:48.421597 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:48.422334 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:48.422875 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:48.423440 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] Filtering removed all hosts for the request with volume ID '135aca05-7e04-45cf-adfe-3297def1f0a1'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:13:48.424147 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] Filtering removed all hosts for the request with volume ID '135aca05-7e04-45cf-adfe-3297def1f0a1'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:13:48.424792 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:13:48.425403 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] Creating message record for request_id = req-8cede243-7531-437b-ac76-4e0c3ab12d63 Sep 24 21:13:48.440272 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:13:48.441496 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] Setting Volume 135aca05-7e04-45cf-adfe-3297def1f0a1 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:13:48.461395 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (00b0aed6-44f0-4b38-828e-d80703320f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:48.465306 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-8cede243-7531-437b-ac76-4e0c3ab12d63 tempest-VolumesBackupsV39Test-144734541 None] Flow 'volume_create_scheduler' (7c936a13-f269-4cf6-8003-a574a15eefb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:54.673429 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] Flow 'volume_create_scheduler' (08c47e0b-ca9f-4506-881b-991a382e9520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:54.677850 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1d413498-7aa1-4a9e-b0b6-0cd2cebafc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:54.697228 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1d413498-7aa1-4a9e-b0b6-0cd2cebafc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(75912735-c377-4232-b3d1-0b69b47513ec),volume_id=75912735-c377-4232-b3d1-0b69b47513ec,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:54.715244 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (20e95ac1-f887-4427-96c7-77cfd2032321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:54.723532 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:13:54.749768 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:13:54.750140 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:13:54.750519 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:54.750873 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:54.751217 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:54.751568 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] Filtering removed all hosts for the request with volume ID '75912735-c377-4232-b3d1-0b69b47513ec'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:13:54.751912 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] Filtering removed all hosts for the request with volume ID '75912735-c377-4232-b3d1-0b69b47513ec'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:13:54.752403 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:13:54.752831 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] Creating message record for request_id = req-86b08d20-ec6d-442b-a4ce-e74958de8059 Sep 24 21:13:54.766539 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:13:54.766915 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] Setting Volume 75912735-c377-4232-b3d1-0b69b47513ec to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:13:54.785050 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (20e95ac1-f887-4427-96c7-77cfd2032321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:54.792505 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-86b08d20-ec6d-442b-a4ce-e74958de8059 tempest-VolumesCloneNegativeTest-217056597 None] Flow 'volume_create_scheduler' (08c47e0b-ca9f-4506-881b-991a382e9520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:57.191646 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] Flow 'volume_create_scheduler' (bf6c6027-5ee3-4e95-9c4c-213c4cb523b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:13:57.209828 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9492e886-3d3b-42f8-95c5-0e78cabbef43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:57.230485 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9492e886-3d3b-42f8-95c5-0e78cabbef43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f3ff1c05-8320-42a7-a5db-d1180d78bc7f),volume_id=f3ff1c05-8320-42a7-a5db-d1180d78bc7f,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:57.240827 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2d88c615-1c85-44d9-ac7e-5357b1358adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:13:57.290131 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:13:57.309515 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:13:57.309898 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:13:57.310975 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:57.311273 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:57.311705 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:13:57.312176 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] Filtering removed all hosts for the request with volume ID 'f3ff1c05-8320-42a7-a5db-d1180d78bc7f'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:13:57.312628 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] Filtering removed all hosts for the request with volume ID 'f3ff1c05-8320-42a7-a5db-d1180d78bc7f'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:13:57.313009 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:13:57.313522 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] Creating message record for request_id = req-6314324c-deea-4df8-9eed-24f19e1ee715 Sep 24 21:13:57.321020 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:13:57.321522 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] Setting Volume f3ff1c05-8320-42a7-a5db-d1180d78bc7f to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:13:57.333859 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2d88c615-1c85-44d9-ac7e-5357b1358adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:13:57.337478 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6314324c-deea-4df8-9eed-24f19e1ee715 tempest-AttachVolumeTestJSON-1763919755 None] Flow 'volume_create_scheduler' (bf6c6027-5ee3-4e95-9c4c-213c4cb523b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:14:01.790801 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] Flow 'volume_create_scheduler' (c587bf87-b7b3-45dd-9339-5d4666a2db77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:14:01.797487 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c5608b1c-4686-4937-b01e-06aae12ee85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:14:01.801515 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c5608b1c-4686-4937-b01e-06aae12ee85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a2825ce2-5f83-453e-a5e9-5b604ab70620),volume_id=a2825ce2-5f83-453e-a5e9-5b604ab70620,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:14:01.806284 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0491d440-551a-4383-89b4-397608334bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:14:01.815446 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:14:01.843841 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:01.844605 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:14:01.845660 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:01.846299 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:01.846915 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:01.847542 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] Filtering removed all hosts for the request with volume ID 'a2825ce2-5f83-453e-a5e9-5b604ab70620'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:14:01.848260 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] Filtering removed all hosts for the request with volume ID 'a2825ce2-5f83-453e-a5e9-5b604ab70620'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:14:01.849097 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:14:01.849771 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] Creating message record for request_id = req-fdf1e377-8afb-4a2d-aade-e1fa66792cda Sep 24 21:14:01.871855 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:14:01.873102 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] Setting Volume a2825ce2-5f83-453e-a5e9-5b604ab70620 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:14:01.888971 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0491d440-551a-4383-89b4-397608334bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:14:01.893589 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-fdf1e377-8afb-4a2d-aade-e1fa66792cda tempest-VolumesSnapshotTestJSON-1772323462 None] Flow 'volume_create_scheduler' (c587bf87-b7b3-45dd-9339-5d4666a2db77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:14:01.897677 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=74,cinder:UPDATE=15,cinder:INSERT=6,cinder:DELETE=5 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:14:07.810080 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-e833a479-7e34-4edc-93c6-110131688bff None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:14:22.943323 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-0dee3c4f-959a-4ba7-836d-ebacbce24481 tempest-GroupSnapshotsTest-1963539787 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:22.961693 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-0dee3c4f-959a-4ba7-836d-ebacbce24481 tempest-GroupSnapshotsTest-1963539787 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:22.962634 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.manager [None req-0dee3c4f-959a-4ba7-836d-ebacbce24481 tempest-GroupSnapshotsTest-1963539787 None] Could not find a backend for group b2f44023-599b-41ec-92f9-7b898b7d076d.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:14:24.816169 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-bef913e8-7154-439e-8a96-f2c00162a76e tempest-GroupSnapshotsTest-1963539787 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:24.830103 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-bef913e8-7154-439e-8a96-f2c00162a76e tempest-GroupSnapshotsTest-1963539787 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:24.833916 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.manager [None req-bef913e8-7154-439e-8a96-f2c00162a76e tempest-GroupSnapshotsTest-1963539787 None] Could not find a backend for group bac365fe-47d2-4b14-9455-995df336d9f4.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:14:26.469533 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-d5129466-bdea-469f-9f1e-f639308ef226 tempest-GroupSnapshotsTest-1963539787 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:26.494754 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-d5129466-bdea-469f-9f1e-f639308ef226 tempest-GroupSnapshotsTest-1963539787 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:26.495321 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.manager [None req-d5129466-bdea-469f-9f1e-f639308ef226 tempest-GroupSnapshotsTest-1963539787 None] Could not find a backend for group 8e67f786-dfe2-45f4-a099-e68549043f2f.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:14:31.494819 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] Flow 'volume_create_scheduler' (87b0a72b-e32d-43e0-9ca4-640a02d28fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:14:31.499251 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0c72ce3c-40ce-4451-b0dc-311afbc6e59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:14:31.504010 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0c72ce3c-40ce-4451-b0dc-311afbc6e59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(38dd9c34-ac03-41d5-bf8f-01d145bc15ba),volume_id=38dd9c34-ac03-41d5-bf8f-01d145bc15ba,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:14:31.507810 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c5867b72-c81c-4396-9826-fea0f1873e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:14:31.517770 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:14:31.539162 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:31.539817 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:14:31.540701 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:31.542010 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:31.542944 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:31.544028 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] Filtering removed all hosts for the request with volume ID '38dd9c34-ac03-41d5-bf8f-01d145bc15ba'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:14:31.544387 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] Filtering removed all hosts for the request with volume ID '38dd9c34-ac03-41d5-bf8f-01d145bc15ba'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:14:31.544901 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:14:31.545343 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] Creating message record for request_id = req-068ce9a5-d455-4922-83bd-f7f30dd70650 Sep 24 21:14:31.565173 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:14:31.565500 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] Setting Volume 38dd9c34-ac03-41d5-bf8f-01d145bc15ba to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:14:31.584929 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c5867b72-c81c-4396-9826-fea0f1873e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:14:31.596915 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-068ce9a5-d455-4922-83bd-f7f30dd70650 tempest-TestVolumeBootPattern-1416871037 None] Flow 'volume_create_scheduler' (87b0a72b-e32d-43e0-9ca4-640a02d28fff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:14:33.952478 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:DELETE=2,cinder:SELECT=36,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:14:34.079859 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] Flow 'volume_create_scheduler' (f35f8664-789d-48dd-9f08-993c00381d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:14:34.109075 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (62ca5ffa-8896-44c0-9777-c46e4d07b457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:14:34.122127 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (62ca5ffa-8896-44c0-9777-c46e4d07b457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a6d49b9a-090b-4694-b84a-f01ffff0ab3f),volume_id=a6d49b9a-090b-4694-b84a-f01ffff0ab3f,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:14:34.136456 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f1fc776b-92e9-4dca-98fd-14d68ec4d10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:14:34.166637 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:14:34.217575 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:34.221009 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:14:34.221530 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:34.222107 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:34.223294 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:34.223832 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] Filtering removed all hosts for the request with volume ID 'a6d49b9a-090b-4694-b84a-f01ffff0ab3f'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:14:34.224309 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] Filtering removed all hosts for the request with volume ID 'a6d49b9a-090b-4694-b84a-f01ffff0ab3f'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:14:34.224995 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:14:34.225668 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] Creating message record for request_id = req-68d43a25-cea7-46fa-b699-0e7cfbadf888 Sep 24 21:14:34.240416 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:14:34.241295 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] Setting Volume a6d49b9a-090b-4694-b84a-f01ffff0ab3f to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:14:34.281668 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f1fc776b-92e9-4dca-98fd-14d68ec4d10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:14:34.301037 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-68d43a25-cea7-46fa-b699-0e7cfbadf888 tempest-TestVolumeBootPattern-1416871037 None] Flow 'volume_create_scheduler' (f35f8664-789d-48dd-9f08-993c00381d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:14:39.274767 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] Flow 'volume_create_scheduler' (e1a88aa6-cfac-47fc-8824-c7126b56a32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:14:39.279836 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8807ba1f-fa1b-456a-a3af-fdc2db5881e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:14:39.287169 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8807ba1f-fa1b-456a-a3af-fdc2db5881e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7dbce016-a23e-403e-a8f7-206e4640f15f),volume_id=7dbce016-a23e-403e-a8f7-206e4640f15f,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:14:39.296549 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b543a41c-a8ce-43d0-b8b2-fec7f53c63e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:14:39.315281 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:14:39.353197 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:39.353578 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:14:39.353931 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:39.354453 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:39.355038 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:39.355574 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] Filtering removed all hosts for the request with volume ID '7dbce016-a23e-403e-a8f7-206e4640f15f'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:14:39.356164 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] Filtering removed all hosts for the request with volume ID '7dbce016-a23e-403e-a8f7-206e4640f15f'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:14:39.356882 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:14:39.357507 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] Creating message record for request_id = req-fd0fe8d9-875d-4c31-9200-3a6088b4364c Sep 24 21:14:39.366208 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:14:39.366912 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] Setting Volume 7dbce016-a23e-403e-a8f7-206e4640f15f to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:14:39.389484 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b543a41c-a8ce-43d0-b8b2-fec7f53c63e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:14:39.392761 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-fd0fe8d9-875d-4c31-9200-3a6088b4364c tempest-TestVolumeBootPattern-1416871037 None] Flow 'volume_create_scheduler' (e1a88aa6-cfac-47fc-8824-c7126b56a32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:14:43.029085 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-798b81dd-3815-4392-bc20-6b7ef24b367d tempest-GroupsTest-1674394690 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:43.066805 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-798b81dd-3815-4392-bc20-6b7ef24b367d tempest-GroupsTest-1674394690 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:43.072069 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.manager [None req-798b81dd-3815-4392-bc20-6b7ef24b367d tempest-GroupsTest-1674394690 None] Could not find a backend for group f91a78af-a237-4132-95a7-927e712e6ad6.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:14:44.601318 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] Flow 'volume_create_scheduler' (fcae6fb8-89b4-4123-bc70-b892562be871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:14:44.611189 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1a7fa244-2f30-4e4e-af45-32444451aa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:14:44.616484 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1a7fa244-2f30-4e4e-af45-32444451aa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(3a8e1dc7-ae46-4fa3-a4f1-7f94ef4dc3eb),volume_id=3a8e1dc7-ae46-4fa3-a4f1-7f94ef4dc3eb,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:14:44.621951 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1de02a91-86bc-408a-b9f2-9932d39401b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:14:44.639225 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:14:44.674045 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:44.674948 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:14:44.675521 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:44.693308 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:44.694974 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:44.695572 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] Filtering removed all hosts for the request with volume ID '3a8e1dc7-ae46-4fa3-a4f1-7f94ef4dc3eb'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:14:44.696169 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] Filtering removed all hosts for the request with volume ID '3a8e1dc7-ae46-4fa3-a4f1-7f94ef4dc3eb'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:14:44.697514 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:14:44.699810 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] Creating message record for request_id = req-4eb70548-2a47-4fbe-87e3-27cdb84665bf Sep 24 21:14:44.711308 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:14:44.712131 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] Setting Volume 3a8e1dc7-ae46-4fa3-a4f1-7f94ef4dc3eb to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:14:44.727374 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1de02a91-86bc-408a-b9f2-9932d39401b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:14:44.733355 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4eb70548-2a47-4fbe-87e3-27cdb84665bf tempest-SnapshotsActionsTest-1723354635 None] Flow 'volume_create_scheduler' (fcae6fb8-89b4-4123-bc70-b892562be871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:14:44.949209 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-91727409-b87b-4589-93ff-8d6cda23b324 tempest-GroupsTest-1674394690 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:44.959817 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-91727409-b87b-4589-93ff-8d6cda23b324 tempest-GroupsTest-1674394690 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:44.960661 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.manager [None req-91727409-b87b-4589-93ff-8d6cda23b324 tempest-GroupsTest-1674394690 None] Could not find a backend for group 52bc74b3-df35-416f-a130-b6419edd6bdd.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:14:53.211139 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-ac631254-608e-4197-b6fb-591e6e8844a1 tempest-GroupsV314Test-490294911 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:53.259465 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-ac631254-608e-4197-b6fb-591e6e8844a1 tempest-GroupsV314Test-490294911 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:53.262158 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.manager [None req-ac631254-608e-4197-b6fb-591e6e8844a1 tempest-GroupsV314Test-490294911 None] Could not find a backend for group 59e505ba-78a9-46a7-baaa-72d14e3ade73.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:14:53.461161 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] Flow 'volume_create_scheduler' (f8caa978-7cb8-4452-981f-f1117d13aca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:14:53.468228 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fa7717e0-73b7-43d2-b54a-b2c83233d4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:14:53.473918 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fa7717e0-73b7-43d2-b54a-b2c83233d4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(feef0296-341c-4315-acdd-4f7f03f41a81),volume_id=feef0296-341c-4315-acdd-4f7f03f41a81,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:14:53.479667 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e3495eae-95c0-49e8-b8f1-d76f2087dc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:14:53.492492 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:14:53.521006 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:53.521377 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:14:53.521891 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:53.522240 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:53.522947 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:53.523433 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] Filtering removed all hosts for the request with volume ID 'feef0296-341c-4315-acdd-4f7f03f41a81'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:14:53.523909 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] Filtering removed all hosts for the request with volume ID 'feef0296-341c-4315-acdd-4f7f03f41a81'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:14:53.524532 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:14:53.525293 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] Creating message record for request_id = req-840a76db-b18a-4038-9d99-2471c5f34045 Sep 24 21:14:53.564032 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:14:53.564558 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] Setting Volume feef0296-341c-4315-acdd-4f7f03f41a81 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:14:53.590051 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e3495eae-95c0-49e8-b8f1-d76f2087dc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:14:53.594948 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-840a76db-b18a-4038-9d99-2471c5f34045 tempest-VolumesTransfersTest-896756958 None] Flow 'volume_create_scheduler' (f8caa978-7cb8-4452-981f-f1117d13aca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:14:55.052300 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] Flow 'volume_create_scheduler' (8470929c-1c34-470d-92fa-e118c36433de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:14:55.062139 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9c16b659-5554-4cad-8936-195cf560200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:14:55.066402 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9c16b659-5554-4cad-8936-195cf560200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(851b2b38-baf6-4f78-a530-c6673324cbde),volume_id=851b2b38-baf6-4f78-a530-c6673324cbde,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:14:55.070041 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (72230fe7-cd7f-4819-a133-c94dfbd81efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:14:55.078849 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:14:55.095154 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:55.095699 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:14:55.096196 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:55.096696 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:55.097218 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:14:55.097726 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] Filtering removed all hosts for the request with volume ID '851b2b38-baf6-4f78-a530-c6673324cbde'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:14:55.098227 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] Filtering removed all hosts for the request with volume ID '851b2b38-baf6-4f78-a530-c6673324cbde'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:14:55.098892 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:14:55.099472 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] Creating message record for request_id = req-adeee940-6dce-4ae5-81ca-f331add17987 Sep 24 21:14:55.109306 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:14:55.109717 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] Setting Volume 851b2b38-baf6-4f78-a530-c6673324cbde to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:14:55.128308 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (72230fe7-cd7f-4819-a133-c94dfbd81efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:14:55.131971 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-adeee940-6dce-4ae5-81ca-f331add17987 tempest-VolumesTransfersTest-896756958 None] Flow 'volume_create_scheduler' (8470929c-1c34-470d-92fa-e118c36433de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:14:55.141176 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=75,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=5 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:14:59.329343 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-386ebedf-5173-4ea3-8e1b-5276778bf92c tempest-GroupsV320Test-1529233743 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:59.335615 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-386ebedf-5173-4ea3-8e1b-5276778bf92c tempest-GroupsV320Test-1529233743 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:14:59.336568 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.manager [None req-386ebedf-5173-4ea3-8e1b-5276778bf92c tempest-GroupsV320Test-1529233743 None] Could not find a backend for group 991b5976-f44e-4e1b-922b-d69031326a38.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:02.456652 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] Flow 'volume_create_scheduler' (747a2eb1-d5cb-435e-8385-134bb005b7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:02.461950 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0c61a1f6-7604-463a-980a-5dde6be25932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:02.468498 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0c61a1f6-7604-463a-980a-5dde6be25932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(d74f7f9a-8756-4fab-91b7-c8ceef3402ec),volume_id=d74f7f9a-8756-4fab-91b7-c8ceef3402ec,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:02.472983 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e2a0e266-e235-4774-b7ec-09e0f2b9e83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:02.485539 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:02.506370 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:02.506852 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:02.507215 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:02.507559 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:02.507997 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:02.508380 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] Filtering removed all hosts for the request with volume ID 'd74f7f9a-8756-4fab-91b7-c8ceef3402ec'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:02.508719 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] Filtering removed all hosts for the request with volume ID 'd74f7f9a-8756-4fab-91b7-c8ceef3402ec'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:02.509516 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:02.510229 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] Creating message record for request_id = req-207f2aa5-2524-4782-a543-e7d136a384b8 Sep 24 21:15:02.518970 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:02.519515 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] Setting Volume d74f7f9a-8756-4fab-91b7-c8ceef3402ec to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:02.534933 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e2a0e266-e235-4774-b7ec-09e0f2b9e83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:02.538024 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-207f2aa5-2524-4782-a543-e7d136a384b8 tempest-VolumesActionsTest-170830234 None] Flow 'volume_create_scheduler' (747a2eb1-d5cb-435e-8385-134bb005b7c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:07.816299 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-4eee1476-71d3-4741-a7fb-92ee719d0d58 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:15:09.848904 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] Flow 'volume_create_scheduler' (07c91305-e355-459b-93fd-825d651b2534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:09.861482 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3536fc66-1423-4efd-8fd9-99c89e62e63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:09.873348 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3536fc66-1423-4efd-8fd9-99c89e62e63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f6e0d058-f1e1-4be1-beec-bcbbfe984613),volume_id=f6e0d058-f1e1-4be1-beec-bcbbfe984613,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:09.877259 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cbbe1613-acae-4219-8e36-2f017197194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:09.889217 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:09.919085 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:09.919696 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:09.920400 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:09.920921 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:09.921454 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:09.922067 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] Filtering removed all hosts for the request with volume ID 'f6e0d058-f1e1-4be1-beec-bcbbfe984613'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:09.922904 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] Filtering removed all hosts for the request with volume ID 'f6e0d058-f1e1-4be1-beec-bcbbfe984613'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:09.923546 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:09.924267 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] Creating message record for request_id = req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 Sep 24 21:15:09.933626 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:09.934252 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] Setting Volume f6e0d058-f1e1-4be1-beec-bcbbfe984613 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:09.962173 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cbbe1613-acae-4219-8e36-2f017197194d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:09.969382 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-e8cbdf38-7e53-40c3-a993-9de14ec7e495 tempest-VolumeQuotasAdminTestJSON-200742512 None] Flow 'volume_create_scheduler' (07c91305-e355-459b-93fd-825d651b2534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:11.342595 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] Flow 'volume_create_scheduler' (64d8f747-d40c-4e74-93d7-ffe53fd90f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:11.358929 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c1c7be3a-4d98-40fd-a878-eb3e746bd878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:11.363515 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c1c7be3a-4d98-40fd-a878-eb3e746bd878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7009b933-2289-45cd-919d-336edc924d28),volume_id=7009b933-2289-45cd-919d-336edc924d28,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:11.376245 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b0711e6f-4b58-4a17-b27b-6e237b235079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:11.392621 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:11.421924 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:11.426129 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:11.426779 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:11.427366 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:11.428393 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:11.430207 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] Filtering removed all hosts for the request with volume ID '7009b933-2289-45cd-919d-336edc924d28'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:11.430714 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] Filtering removed all hosts for the request with volume ID '7009b933-2289-45cd-919d-336edc924d28'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:11.433907 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:11.435859 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] Creating message record for request_id = req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 Sep 24 21:15:11.451296 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:11.452054 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] Setting Volume 7009b933-2289-45cd-919d-336edc924d28 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:11.464873 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b0711e6f-4b58-4a17-b27b-6e237b235079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:11.468296 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-eeb68e50-6104-421e-b25c-7a4c3432dfb2 tempest-VolumeQuotasAdminTestJSON-200742512 None] Flow 'volume_create_scheduler' (64d8f747-d40c-4e74-93d7-ffe53fd90f5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:14.201400 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] Flow 'volume_create_scheduler' (da128838-75c3-427d-98fc-2fe61c87b48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:14.208975 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1023e0ae-562a-4d02-b469-799e6bf58e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:14.231354 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1023e0ae-562a-4d02-b469-799e6bf58e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4101dbf6-dca6-43de-bfb2-ae23022d5d82),volume_id=4101dbf6-dca6-43de-bfb2-ae23022d5d82,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:14.235822 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d5d0080e-5647-4473-89ef-38bfbf63f1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:14.248681 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:14.268970 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:14.270058 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:14.270870 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:14.272533 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:14.273126 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:14.273677 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] Filtering removed all hosts for the request with volume ID '4101dbf6-dca6-43de-bfb2-ae23022d5d82'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:14.274361 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] Filtering removed all hosts for the request with volume ID '4101dbf6-dca6-43de-bfb2-ae23022d5d82'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:14.275816 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:14.276571 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] Creating message record for request_id = req-22f4454e-ba2c-487d-ad54-8205436f7b23 Sep 24 21:15:14.289103 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:14.289621 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] Setting Volume 4101dbf6-dca6-43de-bfb2-ae23022d5d82 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:14.312592 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d5d0080e-5647-4473-89ef-38bfbf63f1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:14.316829 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-22f4454e-ba2c-487d-ad54-8205436f7b23 tempest-VolumesActionsTest-216683067 None] Flow 'volume_create_scheduler' (da128838-75c3-427d-98fc-2fe61c87b48e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:20.623441 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] Flow 'volume_create_scheduler' (48303797-3d2e-4066-b30c-332610565854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:20.647307 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7f9683f9-866f-4948-aa67-c58c6932be8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:20.667525 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7f9683f9-866f-4948-aa67-c58c6932be8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(09514ad2-05db-464d-a0db-798c1ee54358),volume_id=09514ad2-05db-464d-a0db-798c1ee54358,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:20.681633 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7dded10b-9fd1-4c03-a20f-3d468965e2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:20.693862 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:20.771001 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:20.771770 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:20.774691 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:20.775857 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:20.776490 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:20.777420 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] Filtering removed all hosts for the request with volume ID '09514ad2-05db-464d-a0db-798c1ee54358'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:20.778999 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] Filtering removed all hosts for the request with volume ID '09514ad2-05db-464d-a0db-798c1ee54358'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:20.779779 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:20.780410 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] Creating message record for request_id = req-285a3ca1-8769-4a0a-84fb-a56eed87b956 Sep 24 21:15:20.813497 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:20.814044 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] Setting Volume 09514ad2-05db-464d-a0db-798c1ee54358 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:20.839389 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7dded10b-9fd1-4c03-a20f-3d468965e2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:20.851370 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-285a3ca1-8769-4a0a-84fb-a56eed87b956 tempest-VolumesActionsTest-216683067 None] Flow 'volume_create_scheduler' (48303797-3d2e-4066-b30c-332610565854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:21.252788 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] Flow 'volume_create_scheduler' (c314d894-2bc7-4360-8913-5f6a4dc5ba6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:21.257922 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e78264a4-c9fe-43d7-88ca-5d1f2a653123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:21.263326 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e78264a4-c9fe-43d7-88ca-5d1f2a653123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(15b11f98-7ba7-4079-b228-c0b08fdec995),volume_id=15b11f98-7ba7-4079-b228-c0b08fdec995,volume_properties=VolumeProperties,volume_type=VolumeType(495ee722-a356-4d82-9d91-5314369c9bcf))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:21.268224 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1d3d1404-0d58-4f5b-bc4f-1ef8706ebc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:21.278411 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:21.285994 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=75,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=5 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:15:21.296733 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:21.297303 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:21.297989 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:21.298404 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:21.298819 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:21.299173 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] Filtering removed all hosts for the request with volume ID '15b11f98-7ba7-4079-b228-c0b08fdec995'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:21.299562 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] Filtering removed all hosts for the request with volume ID '15b11f98-7ba7-4079-b228-c0b08fdec995'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:21.300109 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] No weighed backend found for volume with properties: {'id': '495ee722-a356-4d82-9d91-5314369c9bcf', 'name': 'volume-type-1', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {}, 'qos_specs_id': None, 'created_at': '2022-09-24T21:15:21.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:21.300588 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] Creating message record for request_id = req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 Sep 24 21:15:21.310225 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:21.310706 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] Setting Volume 15b11f98-7ba7-4079-b228-c0b08fdec995 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:21.331672 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1d3d1404-0d58-4f5b-bc4f-1ef8706ebc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:21.334749 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-ae5aa911-dd21-421d-abcc-1b0cf523b5e0 tempest-VolumeRetypeWithoutMigrationTest-1965841278 None] Flow 'volume_create_scheduler' (c314d894-2bc7-4360-8913-5f6a4dc5ba6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:22.261873 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] Flow 'volume_create_scheduler' (1ce12876-3719-4c11-8448-40fc4bf7e28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:22.266477 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9d9b803a-4751-4cda-a0de-72beb61c8ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:22.276042 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9d9b803a-4751-4cda-a0de-72beb61c8ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(1c38c413-7b05-4dcc-89eb-bdf2e0ea2bc2),volume_id=1c38c413-7b05-4dcc-89eb-bdf2e0ea2bc2,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:22.282595 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f00fba0f-9c6a-4410-ac0d-0ec9acecb822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:22.296578 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:22.315293 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:22.315938 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:22.316430 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:22.316920 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:22.317403 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:22.317891 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] Filtering removed all hosts for the request with volume ID '1c38c413-7b05-4dcc-89eb-bdf2e0ea2bc2'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:22.318641 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] Filtering removed all hosts for the request with volume ID '1c38c413-7b05-4dcc-89eb-bdf2e0ea2bc2'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:22.319134 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:22.319559 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] Creating message record for request_id = req-49150b50-7abd-4b51-8fcf-1cb320bcf959 Sep 24 21:15:22.340944 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:22.341234 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] Setting Volume 1c38c413-7b05-4dcc-89eb-bdf2e0ea2bc2 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:22.363293 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f00fba0f-9c6a-4410-ac0d-0ec9acecb822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:22.366564 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-49150b50-7abd-4b51-8fcf-1cb320bcf959 tempest-VolumesActionsTest-216683067 None] Flow 'volume_create_scheduler' (1ce12876-3719-4c11-8448-40fc4bf7e28f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:23.858903 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] Flow 'volume_create_scheduler' (f0cf6538-5e36-4856-9f05-bf6390ca903a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:23.863168 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6a30f9f4-5db3-4bcd-9d0d-a0bdde99c4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:23.867655 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6a30f9f4-5db3-4bcd-9d0d-a0bdde99c4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c8811ba4-f936-4fcd-a297-b6082da6fb7c),volume_id=c8811ba4-f936-4fcd-a297-b6082da6fb7c,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:23.872021 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d8ba6e96-18e4-4575-9e48-2ea62af51bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:23.879991 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:23.902410 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:23.903147 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:23.910902 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:23.911592 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:23.912763 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:23.913332 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] Filtering removed all hosts for the request with volume ID 'c8811ba4-f936-4fcd-a297-b6082da6fb7c'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:23.913889 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] Filtering removed all hosts for the request with volume ID 'c8811ba4-f936-4fcd-a297-b6082da6fb7c'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:23.914790 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:23.916226 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] Creating message record for request_id = req-07664937-43fa-407f-aa14-e690a4e1736c Sep 24 21:15:23.941929 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:23.942838 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] Setting Volume c8811ba4-f936-4fcd-a297-b6082da6fb7c to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:23.962265 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d8ba6e96-18e4-4575-9e48-2ea62af51bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:23.967398 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-07664937-43fa-407f-aa14-e690a4e1736c tempest-VolumesActionsTest-216683067 None] Flow 'volume_create_scheduler' (f0cf6538-5e36-4856-9f05-bf6390ca903a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:25.499530 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] Flow 'volume_create_scheduler' (b0e32ca3-4494-4058-9d42-14635955a841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:25.510735 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7869ec95-992e-4a33-bef7-95bbd9130540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:25.520434 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7869ec95-992e-4a33-bef7-95bbd9130540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(1c679170-7626-401b-bed1-a8444452edd7),volume_id=1c679170-7626-401b-bed1-a8444452edd7,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:25.525505 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7c13bc66-4b6c-42d6-a707-e3b4430b98f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:25.535766 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:25.558551 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:25.559187 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:25.559860 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:25.560380 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:25.561069 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:25.561585 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] Filtering removed all hosts for the request with volume ID '1c679170-7626-401b-bed1-a8444452edd7'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:25.563419 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] Filtering removed all hosts for the request with volume ID '1c679170-7626-401b-bed1-a8444452edd7'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:25.564147 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:25.565104 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] Creating message record for request_id = req-730e5325-ebcd-4248-b1ab-988947ccb4b8 Sep 24 21:15:25.590413 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:25.590920 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] Setting Volume 1c679170-7626-401b-bed1-a8444452edd7 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:25.625639 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7c13bc66-4b6c-42d6-a707-e3b4430b98f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:25.633086 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-730e5325-ebcd-4248-b1ab-988947ccb4b8 tempest-VolumesActionsTest-216683067 None] Flow 'volume_create_scheduler' (b0e32ca3-4494-4058-9d42-14635955a841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:27.161997 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] Flow 'volume_create_scheduler' (7aa1a58e-31fc-4024-b1c9-f215d905abd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:27.177909 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6ab5ddb9-5afa-4d85-bbc8-468b8357ef30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:27.214213 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6ab5ddb9-5afa-4d85-bbc8-468b8357ef30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(24939d4a-d251-4cb7-be11-c8d93c7d145b),volume_id=24939d4a-d251-4cb7-be11-c8d93c7d145b,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:27.218102 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7a896daa-c795-4ba3-a8dd-d2dcbc41695e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:27.228014 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:27.251447 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:27.252630 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:27.254938 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:27.255469 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:27.256161 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:27.256669 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] Filtering removed all hosts for the request with volume ID '24939d4a-d251-4cb7-be11-c8d93c7d145b'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:27.257368 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] Filtering removed all hosts for the request with volume ID '24939d4a-d251-4cb7-be11-c8d93c7d145b'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:27.258050 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:27.258832 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] Creating message record for request_id = req-9bf6efda-798a-4587-a34c-dd0845be2d3e Sep 24 21:15:27.273956 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:27.275120 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] Setting Volume 24939d4a-d251-4cb7-be11-c8d93c7d145b to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:27.301530 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7a896daa-c795-4ba3-a8dd-d2dcbc41695e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:27.309789 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9bf6efda-798a-4587-a34c-dd0845be2d3e tempest-VolumesActionsTest-216683067 None] Flow 'volume_create_scheduler' (7aa1a58e-31fc-4024-b1c9-f215d905abd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:30.084234 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] Flow 'volume_create_scheduler' (16129769-ab89-4b96-8a0f-e2dbab8b217e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:30.108003 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9b1c91b2-08ee-4a65-a02c-979a26405a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:30.108003 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9b1c91b2-08ee-4a65-a02c-979a26405a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9bccf90b-d1f5-48fb-90ee-cdea555d121b),volume_id=9bccf90b-d1f5-48fb-90ee-cdea555d121b,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:30.110098 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5e725b15-c1a5-493f-be13-5d853b7bf554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:30.127944 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:30.150461 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:30.151089 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:30.151622 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:30.152451 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:30.152982 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:30.155685 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] Filtering removed all hosts for the request with volume ID '9bccf90b-d1f5-48fb-90ee-cdea555d121b'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:30.156232 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] Filtering removed all hosts for the request with volume ID '9bccf90b-d1f5-48fb-90ee-cdea555d121b'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:30.156917 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:30.158277 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] Creating message record for request_id = req-d6eb352c-81f9-464c-bccb-c9047623bb05 Sep 24 21:15:30.167669 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:30.168270 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] Setting Volume 9bccf90b-d1f5-48fb-90ee-cdea555d121b to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:30.181458 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5e725b15-c1a5-493f-be13-5d853b7bf554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:30.184828 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-d6eb352c-81f9-464c-bccb-c9047623bb05 tempest-VolumeSnapshotQuotasNegativeTestJSON-1024884195 None] Flow 'volume_create_scheduler' (16129769-ab89-4b96-8a0f-e2dbab8b217e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:36.900716 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] Flow 'volume_create_scheduler' (f39d17d9-8689-4bee-baaa-13d0a5f9ce96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:36.908084 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a43e505d-3a75-4689-bb21-1396534672ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:36.924334 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a43e505d-3a75-4689-bb21-1396534672ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f17057d8-9020-4a8c-80b9-d106e22162f7),volume_id=f17057d8-9020-4a8c-80b9-d106e22162f7,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:36.929893 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f34ae97b-9b06-4f21-a51b-968771e339a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:36.952681 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:36.983805 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=74,cinder:INSERT=6,cinder:UPDATE=14,cinder:DELETE=6 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:15:36.985546 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:36.985881 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:36.986304 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:36.986602 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:36.986946 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:36.988893 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] Filtering removed all hosts for the request with volume ID 'f17057d8-9020-4a8c-80b9-d106e22162f7'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:36.989251 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] Filtering removed all hosts for the request with volume ID 'f17057d8-9020-4a8c-80b9-d106e22162f7'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:36.990053 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:36.990822 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] Creating message record for request_id = req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 Sep 24 21:15:37.011935 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:37.012540 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] Setting Volume f17057d8-9020-4a8c-80b9-d106e22162f7 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:37.029590 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f34ae97b-9b06-4f21-a51b-968771e339a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:37.035557 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-078b7fc0-7cd9-4950-95f3-ebadecbfaf23 tempest-AttachVolumeTestJSON-1763919755 None] Flow 'volume_create_scheduler' (f39d17d9-8689-4bee-baaa-13d0a5f9ce96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:39.585877 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] Flow 'volume_create_scheduler' (5ff9f56f-f0e6-4f20-9244-f51fd24347c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:39.596781 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5ac1f3fc-a5a4-4489-b290-e0f2087ccc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:39.603287 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5ac1f3fc-a5a4-4489-b290-e0f2087ccc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(52078778-ed2e-4f0f-ac10-b08c1c945dbd),volume_id=52078778-ed2e-4f0f-ac10-b08c1c945dbd,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:39.623592 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (42340447-6446-4467-90e8-35d708e9858d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:39.636678 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:39.665780 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:39.666400 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:39.666929 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:39.667537 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:39.668037 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:39.668538 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] Filtering removed all hosts for the request with volume ID '52078778-ed2e-4f0f-ac10-b08c1c945dbd'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:39.669050 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] Filtering removed all hosts for the request with volume ID '52078778-ed2e-4f0f-ac10-b08c1c945dbd'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:39.669694 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:39.670293 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] Creating message record for request_id = req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 Sep 24 21:15:39.693611 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:39.694044 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] Setting Volume 52078778-ed2e-4f0f-ac10-b08c1c945dbd to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:39.718739 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] Flow 'volume_create_scheduler' (fa265deb-f301-4aef-a9f5-5819d1de6331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:39.724233 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (237f4aef-5f56-41d9-8572-133c346235b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:39.728798 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (237f4aef-5f56-41d9-8572-133c346235b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7ace6e75-5b00-4c8d-8c9a-82b325cddb08),volume_id=7ace6e75-5b00-4c8d-8c9a-82b325cddb08,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:39.732364 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (926af390-0211-407a-b2a1-3eabff3f7082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:39.744194 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:39.760153 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:39.760531 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:39.761000 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:39.761515 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:39.762046 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:39.762570 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] Filtering removed all hosts for the request with volume ID '7ace6e75-5b00-4c8d-8c9a-82b325cddb08'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:39.763065 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] Filtering removed all hosts for the request with volume ID '7ace6e75-5b00-4c8d-8c9a-82b325cddb08'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:39.763882 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:39.764787 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] Creating message record for request_id = req-73583418-cf64-46e2-bd6e-d02080eb231e Sep 24 21:15:39.773360 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (42340447-6446-4467-90e8-35d708e9858d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:39.777156 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-7eaa652a-9ec0-4aa4-a54f-69f720e5ad52 tempest-VolumesMetadataTest-1529089375 None] Flow 'volume_create_scheduler' (5ff9f56f-f0e6-4f20-9244-f51fd24347c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:39.802018 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:39.802444 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] Setting Volume 7ace6e75-5b00-4c8d-8c9a-82b325cddb08 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:39.829991 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (926af390-0211-407a-b2a1-3eabff3f7082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:39.849608 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-73583418-cf64-46e2-bd6e-d02080eb231e tempest-AbsoluteLimitsTests-1791320374 None] Flow 'volume_create_scheduler' (fa265deb-f301-4aef-a9f5-5819d1de6331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:46.817427 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] Flow 'volume_create_scheduler' (3df07c81-9715-42e7-b651-ef829b8b8bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:46.826200 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d0948f18-8702-4b86-86d5-9920d90d2c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:46.833224 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d0948f18-8702-4b86-86d5-9920d90d2c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(59fd48d6-f9ec-42a4-b770-2fbfe551eeea),volume_id=59fd48d6-f9ec-42a4-b770-2fbfe551eeea,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:46.838370 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c277e283-cc09-4a71-a6ef-bc4bae08ad0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:46.849290 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:46.872404 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:46.873221 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:46.875029 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:46.876243 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:46.876791 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:46.877335 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] Filtering removed all hosts for the request with volume ID '59fd48d6-f9ec-42a4-b770-2fbfe551eeea'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:46.878100 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] Filtering removed all hosts for the request with volume ID '59fd48d6-f9ec-42a4-b770-2fbfe551eeea'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:46.878843 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:46.880241 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] Creating message record for request_id = req-5edb812c-e4f4-4794-be01-89e745d968dd Sep 24 21:15:46.903034 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:46.903735 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] Setting Volume 59fd48d6-f9ec-42a4-b770-2fbfe551eeea to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:46.922765 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c277e283-cc09-4a71-a6ef-bc4bae08ad0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:46.931304 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-5edb812c-e4f4-4794-be01-89e745d968dd tempest-VolumesGetTest-1022670745 None] Flow 'volume_create_scheduler' (3df07c81-9715-42e7-b651-ef829b8b8bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:49.300604 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] Flow 'volume_create_scheduler' (6d0b689e-51a9-4837-b2a3-232d6aa321a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:49.305566 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6ca9c529-b874-4be5-a394-a65aa6b8dfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:49.314555 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6ca9c529-b874-4be5-a394-a65aa6b8dfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(448d95b9-97f0-4fe5-95d6-02749a50d674),volume_id=448d95b9-97f0-4fe5-95d6-02749a50d674,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:49.321479 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b84c1ebd-b00e-471f-8cbf-683eca39f28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:49.340060 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:49.372692 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:49.373183 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:49.373758 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:49.374303 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:49.374864 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:49.375424 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] Filtering removed all hosts for the request with volume ID '448d95b9-97f0-4fe5-95d6-02749a50d674'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:49.375982 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] Filtering removed all hosts for the request with volume ID '448d95b9-97f0-4fe5-95d6-02749a50d674'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:49.376671 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:49.377308 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] Creating message record for request_id = req-00bd152f-c5a7-4541-bbfc-150309d88ace Sep 24 21:15:49.391298 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:49.392031 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] Setting Volume 448d95b9-97f0-4fe5-95d6-02749a50d674 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:49.405544 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b84c1ebd-b00e-471f-8cbf-683eca39f28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:49.409048 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00bd152f-c5a7-4541-bbfc-150309d88ace tempest-VolumesGetTest-1022670745 None] Flow 'volume_create_scheduler' (6d0b689e-51a9-4837-b2a3-232d6aa321a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:51.196152 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] Flow 'volume_create_scheduler' (e9da22b3-05ae-4ffb-8bf6-f26e45846dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:51.210026 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (eee3dd20-3bbb-45b4-aa03-6340f34ad3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:51.214669 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (eee3dd20-3bbb-45b4-aa03-6340f34ad3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(1e1d44d7-f873-4184-8710-b080c6dc08ef),volume_id=1e1d44d7-f873-4184-8710-b080c6dc08ef,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:51.218232 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (57f376b0-ee09-4149-9d3e-59c86c53d3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:51.251931 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:51.274377 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:51.274769 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:51.279352 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:51.282689 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:51.283138 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:51.283573 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] Filtering removed all hosts for the request with volume ID '1e1d44d7-f873-4184-8710-b080c6dc08ef'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:51.283997 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] Filtering removed all hosts for the request with volume ID '1e1d44d7-f873-4184-8710-b080c6dc08ef'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:51.284693 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:51.285193 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] Creating message record for request_id = req-26805dd0-97e9-446f-b395-7b83d9f142ac Sep 24 21:15:51.307364 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:51.307745 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] Setting Volume 1e1d44d7-f873-4184-8710-b080c6dc08ef to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:51.327270 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (57f376b0-ee09-4149-9d3e-59c86c53d3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:51.341408 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-26805dd0-97e9-446f-b395-7b83d9f142ac tempest-VolumesGetTest-1022670745 None] Flow 'volume_create_scheduler' (e9da22b3-05ae-4ffb-8bf6-f26e45846dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:57.383092 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] Flow 'volume_create_scheduler' (71ca1818-a363-4cf3-ae2e-547515155bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:15:57.395765 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ed3ead09-e85a-4283-ae7f-840fcbf9e417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:57.404261 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ed3ead09-e85a-4283-ae7f-840fcbf9e417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2274822d-da41-4d8f-8917-b2c6de04c872),volume_id=2274822d-da41-4d8f-8917-b2c6de04c872,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:57.421573 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0d3dafd4-277e-44ea-9772-324dfbf8eb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:15:57.436944 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:15:57.468179 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:15:57.468643 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:15:57.469044 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:57.469369 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:57.469858 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:15:57.470222 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] Filtering removed all hosts for the request with volume ID '2274822d-da41-4d8f-8917-b2c6de04c872'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:15:57.470557 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] Filtering removed all hosts for the request with volume ID '2274822d-da41-4d8f-8917-b2c6de04c872'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:15:57.471227 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:15:57.471834 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] Creating message record for request_id = req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed Sep 24 21:15:57.475688 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=73,cinder:INSERT=7,cinder:UPDATE=14,cinder:DELETE=6 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:15:57.488374 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:15:57.489044 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] Setting Volume 2274822d-da41-4d8f-8917-b2c6de04c872 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:15:57.506339 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0d3dafd4-277e-44ea-9772-324dfbf8eb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:15:57.512111 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4752bb5b-6482-43d4-a4da-c4fd1950c9ed tempest-VolumesNegativeTest-1897315638 None] Flow 'volume_create_scheduler' (71ca1818-a363-4cf3-ae2e-547515155bef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:16:07.815049 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-412989c8-ecd7-47d0-9491-2fe67c9ee2a0 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:16:36.322101 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:17:06.334457 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:17:07.807523 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-6a2e5200-5b32-4d7a-b556-97eb551cf88f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:17:46.348271 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:18:07.812210 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-6634e67c-2def-4317-8535-1d6e8182e878 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:18:26.353507 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:19:06.358276 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:19:07.819500 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-8605f4dd-05c2-4888-a829-5d5d769891a8 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:19:46.133252 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:19:46.140317 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-5e136c31-ccd2-488c-ad4f-21193148ef23 tempest-BackendsCapabilitiesAdminTestsJSON-825186068 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:19:46.171543 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-b5c883f4-fdb4-4ea2-9e47-967515d582e3 tempest-BackendsCapabilitiesAdminTestsJSON-825186068 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:19:51.803362 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] Flow 'volume_create_scheduler' (b80325a8-24bb-4e8c-af7c-f7fe59a5e796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:19:51.807513 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (bd7b32d7-aa93-4c33-a657-f29a74f69d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:19:51.811389 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (bd7b32d7-aa93-4c33-a657-f29a74f69d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(183ccd0a-db07-4a9b-9f1c-b46fcf3c0422),volume_id=183ccd0a-db07-4a9b-9f1c-b46fcf3c0422,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:19:51.814791 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (88527b6a-d076-43da-865d-7aa2da9ae4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:19:51.822635 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:19:51.836769 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:19:51.837169 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:19:51.837530 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:19:51.837886 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:19:51.838233 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:19:51.839142 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] Filtering removed all hosts for the request with volume ID '183ccd0a-db07-4a9b-9f1c-b46fcf3c0422'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:19:51.839491 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] Filtering removed all hosts for the request with volume ID '183ccd0a-db07-4a9b-9f1c-b46fcf3c0422'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:19:51.839970 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:19:51.840394 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] Creating message record for request_id = req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 Sep 24 21:19:51.846514 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:19:51.846897 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] Setting Volume 183ccd0a-db07-4a9b-9f1c-b46fcf3c0422 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:19:51.857331 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (88527b6a-d076-43da-865d-7aa2da9ae4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:19:51.860557 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-0a0d4272-c7a6-4dd5-93aa-2a85e85ed418 tempest-VolumeQuotasNegativeTestJSON-2132159925 None] Flow 'volume_create_scheduler' (b80325a8-24bb-4e8c-af7c-f7fe59a5e796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:19:55.958019 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] Flow 'volume_create_scheduler' (ecf01f57-346a-46b0-a568-55134841a90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:19:55.962567 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (156ff386-d9b7-4eba-b9d4-be7c9ecb8cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:19:55.966919 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (156ff386-d9b7-4eba-b9d4-be7c9ecb8cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(51786081-6d5e-4dd1-a3b1-0bed4ce8c979),volume_id=51786081-6d5e-4dd1-a3b1-0bed4ce8c979,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:19:55.970297 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (390ec752-a3a3-4038-935b-92b79618b31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:19:55.977954 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:19:55.991832 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:19:55.992201 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:19:55.992554 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:19:55.992903 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:19:55.993248 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:19:55.993595 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] Filtering removed all hosts for the request with volume ID '51786081-6d5e-4dd1-a3b1-0bed4ce8c979'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:19:55.993938 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] Filtering removed all hosts for the request with volume ID '51786081-6d5e-4dd1-a3b1-0bed4ce8c979'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:19:55.994420 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:19:55.995382 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] Creating message record for request_id = req-1739699b-4224-4e8e-8cf4-561400fe9a0e Sep 24 21:19:56.001589 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:19:56.001965 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] Setting Volume 51786081-6d5e-4dd1-a3b1-0bed4ce8c979 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:19:56.012215 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (390ec752-a3a3-4038-935b-92b79618b31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:19:56.015360 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-1739699b-4224-4e8e-8cf4-561400fe9a0e tempest-VolumesBackupsAdminTest-406072118 None] Flow 'volume_create_scheduler' (ecf01f57-346a-46b0-a568-55134841a90d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:19:57.298456 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] Flow 'volume_create_scheduler' (fdebe361-8518-4186-a366-06498518e3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:19:57.303395 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (45639e5c-bf4e-4be5-869b-3f5f0044b158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:19:57.308925 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (45639e5c-bf4e-4be5-869b-3f5f0044b158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(1531c195-ed79-4c12-9710-21ff1e5068e6),volume_id=1531c195-ed79-4c12-9710-21ff1e5068e6,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:19:57.312729 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (dbdc2d3d-3302-4084-96c4-4e1455a5e2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:19:57.321661 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:19:57.339049 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:19:57.339570 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:19:57.339928 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:19:57.340280 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:19:57.340652 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:19:57.341002 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] Filtering removed all hosts for the request with volume ID '1531c195-ed79-4c12-9710-21ff1e5068e6'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:19:57.341345 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] Filtering removed all hosts for the request with volume ID '1531c195-ed79-4c12-9710-21ff1e5068e6'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:19:57.341898 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:19:57.342328 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] Creating message record for request_id = req-68d44d93-5518-4c65-9306-80a995f28962 Sep 24 21:19:57.350096 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:19:57.350477 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] Setting Volume 1531c195-ed79-4c12-9710-21ff1e5068e6 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:19:57.361195 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (dbdc2d3d-3302-4084-96c4-4e1455a5e2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:19:57.364363 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-68d44d93-5518-4c65-9306-80a995f28962 tempest-VolumesBackupsAdminTest-406072118 None] Flow 'volume_create_scheduler' (fdebe361-8518-4186-a366-06498518e3f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:20:07.820005 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-258ff2fe-ecbd-47b4-bf43-557e75fa409e None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:20:16.378052 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=46,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:20:56.390808 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:21:07.825958 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-3508f22a-8379-48ff-a801-5e5aa7bcccfd None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:21:26.400934 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:21:56.412419 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:07.831169 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-e4456729-ffd3-4098-bf24-69b5d9fe908d None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:22:26.426038 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:22:56.438272 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:23:07.831470 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-7780a5f8-1297-42ac-9888-c9fee976f911 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:23:26.451179 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:23:31.036529 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] Flow 'volume_create_scheduler' (b96181c7-7542-4c7c-96fc-bc5f70af388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:23:31.040561 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (12f9bdab-34c1-4ac7-82f0-d4996900e417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:23:31.044693 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (12f9bdab-34c1-4ac7-82f0-d4996900e417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(13897f33-0ce6-42f0-ab12-2a11fbc85012),volume_id=13897f33-0ce6-42f0-ab12-2a11fbc85012,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:23:31.048057 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3cd7c892-b29c-43af-a95f-31d92d4ccbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:23:31.056088 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:23:31.070526 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:23:31.070915 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:23:31.071274 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:23:31.071626 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:23:31.071974 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:23:31.072322 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] Filtering removed all hosts for the request with volume ID '13897f33-0ce6-42f0-ab12-2a11fbc85012'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:23:31.072666 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] Filtering removed all hosts for the request with volume ID '13897f33-0ce6-42f0-ab12-2a11fbc85012'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:23:31.073149 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:23:31.073575 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] Creating message record for request_id = req-6f993339-7145-4055-b382-8a6f1b463b50 Sep 24 21:23:31.081103 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:23:31.081450 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] Setting Volume 13897f33-0ce6-42f0-ab12-2a11fbc85012 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:23:31.092302 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3cd7c892-b29c-43af-a95f-31d92d4ccbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:23:31.095624 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-6f993339-7145-4055-b382-8a6f1b463b50 tempest-AttachSCSIVolumeTestJSON-46121229 None] Flow 'volume_create_scheduler' (b96181c7-7542-4c7c-96fc-bc5f70af388b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:23:56.467681 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=5,cinder:SELECT=20,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:24:07.828955 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-948f3f05-016e-42aa-834f-230f4f98b597 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:24:36.468327 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:07.825643 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-c07d300e-03aa-4800-b231-63e037a435f3 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:25:16.471303 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:25:46.482229 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:26:07.823550 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-fb3c7b05-c40b-48fc-9a36-00bd68a00116 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:26:16.488905 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:26:46.502913 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:26:55.921006 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] Flow 'volume_create_scheduler' (00d975c0-65b1-4ed4-a8f4-16881a9c63c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:26:55.926004 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (97d1f214-d504-4c81-9d81-c470ad035714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:26:55.929920 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (97d1f214-d504-4c81-9d81-c470ad035714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a57b8d10-6145-4ff6-b0c3-ed912eaedf94),volume_id=a57b8d10-6145-4ff6-b0c3-ed912eaedf94,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:26:55.933366 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cad51ef2-d8fe-4673-ac4a-386f7e4d6057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:26:55.942576 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:26:55.957423 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:26:55.957797 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:26:55.958157 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:26:55.958534 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:26:55.958891 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:26:55.959244 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] Filtering removed all hosts for the request with volume ID 'a57b8d10-6145-4ff6-b0c3-ed912eaedf94'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:26:55.959594 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] Filtering removed all hosts for the request with volume ID 'a57b8d10-6145-4ff6-b0c3-ed912eaedf94'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:26:55.960096 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:26:55.960515 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] Creating message record for request_id = req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e Sep 24 21:26:55.968249 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:26:55.968631 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] Setting Volume a57b8d10-6145-4ff6-b0c3-ed912eaedf94 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:26:55.979550 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cad51ef2-d8fe-4673-ac4a-386f7e4d6057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:26:55.982715 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00fe6cfc-53fc-45f8-b1a3-be6e2ed5993e tempest-TaggedBootDevicesTest_v242-1186823103 None] Flow 'volume_create_scheduler' (00d975c0-65b1-4ed4-a8f4-16881a9c63c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:27:07.820851 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-934e609d-fd9b-49e9-9e5f-0f3e8ae30924 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:27:16.510349 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=5,cinder:SELECT=18,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:27:56.525024 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:28:07.824806 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-9885129a-f9bf-4d0d-9f46-69834a71b905 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:28:26.537566 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:28:56.553181 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:29:07.830884 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-1e25c572-138a-4375-b918-f03f9ccf987b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:29:36.553001 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:29:43.759444 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] Flow 'volume_create_scheduler' (88241eb2-3d6a-469c-9c18-6c97b6808f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:29:43.763546 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9226b1a1-f659-4e58-b4ca-def89656a56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:29:43.767373 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9226b1a1-f659-4e58-b4ca-def89656a56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9e644567-be41-44be-9eaf-43a6364ec39a),volume_id=9e644567-be41-44be-9eaf-43a6364ec39a,volume_properties=VolumeProperties,volume_type=VolumeType(6a546c66-16f3-4524-9432-298f73ab6468))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:29:43.770804 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ec0c0944-3a95-45f1-b869-14d6b056b14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:29:43.780142 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:29:43.793928 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:29:43.794300 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:29:43.794695 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:29:43.795050 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:29:43.795397 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:29:43.795745 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] Filtering removed all hosts for the request with volume ID '9e644567-be41-44be-9eaf-43a6364ec39a'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:29:43.796091 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] Filtering removed all hosts for the request with volume ID '9e644567-be41-44be-9eaf-43a6364ec39a'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:29:43.796574 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] No weighed backend found for volume with properties: {'id': '6a546c66-16f3-4524-9432-298f73ab6468', 'name': 'tempest-VolumeTypesTest-volume-type-377886834', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'}, 'qos_specs_id': None, 'created_at': '2022-09-24T21:29:43.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:29:43.797001 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] Creating message record for request_id = req-a1494918-8e7d-4e95-829a-08180ca1b4f0 Sep 24 21:29:43.804232 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:29:43.804603 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] Setting Volume 9e644567-be41-44be-9eaf-43a6364ec39a to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:29:43.814923 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ec0c0944-3a95-45f1-b869-14d6b056b14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:29:43.818799 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-a1494918-8e7d-4e95-829a-08180ca1b4f0 tempest-VolumeTypesTest-239360960 None] Flow 'volume_create_scheduler' (88241eb2-3d6a-469c-9c18-6c97b6808f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:29:51.104111 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] Flow 'volume_create_scheduler' (1045ecd2-5ec0-4b76-a95e-d1e5d08ece5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:29:51.108138 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1c508906-c4d7-43eb-9531-6eeea6004b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:29:51.111928 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1c508906-c4d7-43eb-9531-6eeea6004b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b5efe021-0610-4623-8a4b-f33146b890ed),volume_id=b5efe021-0610-4623-8a4b-f33146b890ed,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:29:51.116038 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (72fa4379-c1e7-4583-98ff-1b3328ab9d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:29:51.124046 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:29:51.138825 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:29:51.139197 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:29:51.139554 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:29:51.139907 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:29:51.140250 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:29:51.140599 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] Filtering removed all hosts for the request with volume ID 'b5efe021-0610-4623-8a4b-f33146b890ed'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:29:51.140944 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] Filtering removed all hosts for the request with volume ID 'b5efe021-0610-4623-8a4b-f33146b890ed'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:29:51.141428 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:29:51.141856 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] Creating message record for request_id = req-23f5a372-ba89-4e9d-9331-1e997773e1c5 Sep 24 21:29:51.148053 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:29:51.148520 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] Setting Volume b5efe021-0610-4623-8a4b-f33146b890ed to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:29:51.158541 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (72fa4379-c1e7-4583-98ff-1b3328ab9d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:29:51.161653 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-23f5a372-ba89-4e9d-9331-1e997773e1c5 tempest-SnapshotMetadataTestJSON-1811533988 None] Flow 'volume_create_scheduler' (1045ecd2-5ec0-4b76-a95e-d1e5d08ece5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:29:53.952583 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] Flow 'volume_create_scheduler' (47d8fec8-1afa-49ee-bc0d-0009d07e51d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:29:53.956705 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (83e1ce2e-0163-4f2e-a686-aa80c4bfc67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:29:53.961340 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (83e1ce2e-0163-4f2e-a686-aa80c4bfc67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7cbce610-a58a-48b8-a3e5-2add3a7fe4f4),volume_id=7cbce610-a58a-48b8-a3e5-2add3a7fe4f4,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:29:53.964743 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d3a26777-1dc5-4a86-8d1e-974ff5382ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:29:53.973056 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:29:53.987003 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:29:53.987376 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:29:53.987732 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:29:53.988080 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:29:53.988427 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:29:53.988773 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] Filtering removed all hosts for the request with volume ID '7cbce610-a58a-48b8-a3e5-2add3a7fe4f4'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:29:53.989113 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] Filtering removed all hosts for the request with volume ID '7cbce610-a58a-48b8-a3e5-2add3a7fe4f4'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:29:53.990190 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:29:53.990635 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] Creating message record for request_id = req-b960276c-7b57-4789-ac2a-6fee051dd22d Sep 24 21:29:53.997657 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:29:53.998028 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] Setting Volume 7cbce610-a58a-48b8-a3e5-2add3a7fe4f4 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:29:54.007845 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d3a26777-1dc5-4a86-8d1e-974ff5382ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:29:54.011027 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-b960276c-7b57-4789-ac2a-6fee051dd22d tempest-VolumesDeleteCascade-711789254 None] Flow 'volume_create_scheduler' (47d8fec8-1afa-49ee-bc0d-0009d07e51d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:29:57.810229 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] Flow 'volume_create_scheduler' (e44c3ca3-f270-46e7-b199-129db13d2b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:29:57.814228 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f099759a-a637-4f58-8435-2a6bb4dde971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:29:57.818735 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f099759a-a637-4f58-8435-2a6bb4dde971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7d58bb35-f820-4e63-a63c-529c02c246c9),volume_id=7d58bb35-f820-4e63-a63c-529c02c246c9,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:29:57.822281 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ebc338e8-96da-4014-9da6-4d6146c27556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:29:57.830206 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:29:57.844717 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:29:57.845035 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:29:57.845382 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:29:57.845726 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:29:57.846068 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:29:57.846409 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] Filtering removed all hosts for the request with volume ID '7d58bb35-f820-4e63-a63c-529c02c246c9'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:29:57.846772 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] Filtering removed all hosts for the request with volume ID '7d58bb35-f820-4e63-a63c-529c02c246c9'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:29:57.847250 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:29:57.847667 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] Creating message record for request_id = req-00459ecd-da1c-4a05-a97b-76204042e07b Sep 24 21:29:57.855188 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:29:57.855562 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] Setting Volume 7d58bb35-f820-4e63-a63c-529c02c246c9 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:29:57.865579 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ebc338e8-96da-4014-9da6-4d6146c27556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:29:57.868819 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-00459ecd-da1c-4a05-a97b-76204042e07b tempest-VolumesTransfersV355Test-1810315429 None] Flow 'volume_create_scheduler' (e44c3ca3-f270-46e7-b199-129db13d2b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:29:59.134381 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] Flow 'volume_create_scheduler' (afed1e08-0718-496c-af3f-cdf23125aa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:29:59.138845 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (abd4f04b-eda8-4cab-a2eb-8ed1daedc2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:29:59.142814 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (abd4f04b-eda8-4cab-a2eb-8ed1daedc2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c5923534-4d76-48a1-b347-7d98a898b774),volume_id=c5923534-4d76-48a1-b347-7d98a898b774,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:29:59.146762 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (893bbc12-ec9d-4782-bca8-755299326a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:29:59.155339 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:29:59.169209 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:29:59.169574 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:29:59.169928 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:29:59.170271 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:29:59.170639 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:29:59.170985 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] Filtering removed all hosts for the request with volume ID 'c5923534-4d76-48a1-b347-7d98a898b774'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:29:59.171328 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] Filtering removed all hosts for the request with volume ID 'c5923534-4d76-48a1-b347-7d98a898b774'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:29:59.171804 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:29:59.172225 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] Creating message record for request_id = req-18b1594d-53b9-4703-a91f-eceb24fc9526 Sep 24 21:29:59.179644 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:29:59.180051 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] Setting Volume c5923534-4d76-48a1-b347-7d98a898b774 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:29:59.189904 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (893bbc12-ec9d-4782-bca8-755299326a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:29:59.193612 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-18b1594d-53b9-4703-a91f-eceb24fc9526 tempest-VolumesTransfersV355Test-1810315429 None] Flow 'volume_create_scheduler' (afed1e08-0718-496c-af3f-cdf23125aa4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:30:03.466444 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] Flow 'volume_create_scheduler' (41f80855-9841-4031-b836-5a71d8e695bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:30:03.470576 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2df89654-15bc-42cf-9ad5-556a0e1d364b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:30:03.474997 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2df89654-15bc-42cf-9ad5-556a0e1d364b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(044dd3f6-0c86-4738-bb4e-ff16253accd7),volume_id=044dd3f6-0c86-4738-bb4e-ff16253accd7,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:30:03.478284 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9b1d3e5f-e4ac-402c-97d8-a54825d65135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:30:03.486165 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:30:03.505493 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:30:03.505493 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:30:03.505493 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:30:03.505493 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:30:03.505493 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:30:03.505493 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] Filtering removed all hosts for the request with volume ID '044dd3f6-0c86-4738-bb4e-ff16253accd7'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:30:03.505493 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] Filtering removed all hosts for the request with volume ID '044dd3f6-0c86-4738-bb4e-ff16253accd7'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:30:03.505493 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:30:03.505493 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] Creating message record for request_id = req-724350e8-cf4f-4725-a9cf-20acd0054615 Sep 24 21:30:03.509935 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:30:03.510304 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] Setting Volume 044dd3f6-0c86-4738-bb4e-ff16253accd7 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:30:03.520046 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9b1d3e5f-e4ac-402c-97d8-a54825d65135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:30:03.523382 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-724350e8-cf4f-4725-a9cf-20acd0054615 tempest-VolumesCloneTest-174694289 None] Flow 'volume_create_scheduler' (41f80855-9841-4031-b836-5a71d8e695bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:30:03.526678 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=74,cinder:UPDATE=15,cinder:INSERT=6,cinder:DELETE=5 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:30:04.789964 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] Flow 'volume_create_scheduler' (1bddf91b-b9eb-40a5-a864-4aca58b54cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:30:04.794427 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (12c274bb-af7e-4d46-9bce-6caa4eb6f868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:30:04.798278 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (12c274bb-af7e-4d46-9bce-6caa4eb6f868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(16a9a6ec-f12e-4200-9234-275e315acf27),volume_id=16a9a6ec-f12e-4200-9234-275e315acf27,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:30:04.801705 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d8b600f2-ead0-40bc-a4c0-8311b8d71927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:30:04.809935 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:30:04.823972 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:30:04.824342 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:30:04.824694 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:30:04.825045 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:30:04.825385 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:30:04.825729 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] Filtering removed all hosts for the request with volume ID '16a9a6ec-f12e-4200-9234-275e315acf27'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:30:04.826070 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] Filtering removed all hosts for the request with volume ID '16a9a6ec-f12e-4200-9234-275e315acf27'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:30:04.826573 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:30:04.827001 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] Creating message record for request_id = req-4fc2b367-02c7-4d90-9513-6ac2557b0037 Sep 24 21:30:04.833400 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:30:04.834003 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] Setting Volume 16a9a6ec-f12e-4200-9234-275e315acf27 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:30:04.844091 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d8b600f2-ead0-40bc-a4c0-8311b8d71927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:30:04.847195 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-4fc2b367-02c7-4d90-9513-6ac2557b0037 tempest-VolumesCloneTest-174694289 None] Flow 'volume_create_scheduler' (1bddf91b-b9eb-40a5-a864-4aca58b54cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:30:07.836304 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-671e3dea-1378-4d8d-9954-04caac26652b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:30:07.924823 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] Flow 'volume_create_scheduler' (fa46e741-2ac9-469e-a90b-4adaf88e9337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:30:07.929227 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f6ce7af1-2aa2-4ae3-8db4-71092267f418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:30:07.933450 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f6ce7af1-2aa2-4ae3-8db4-71092267f418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(696db92a-7646-46c9-b79e-1eb63df61024),volume_id=696db92a-7646-46c9-b79e-1eb63df61024,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:30:07.936804 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (eb444fba-8d28-4c76-981b-7e9404ad2bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:30:07.945301 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:30:07.958577 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:30:07.959768 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:30:07.960381 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:30:07.960981 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:30:07.961566 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:30:07.961920 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] Filtering removed all hosts for the request with volume ID '696db92a-7646-46c9-b79e-1eb63df61024'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:30:07.962267 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] Filtering removed all hosts for the request with volume ID '696db92a-7646-46c9-b79e-1eb63df61024'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:30:07.962774 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:30:07.963202 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] Creating message record for request_id = req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 Sep 24 21:30:07.969866 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:30:07.970414 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] Setting Volume 696db92a-7646-46c9-b79e-1eb63df61024 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:30:07.980527 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (eb444fba-8d28-4c76-981b-7e9404ad2bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:30:07.983636 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-9a76e0fb-96f3-49b8-bae4-6ffc8152b033 tempest-VolumesExtendTest-458953070 None] Flow 'volume_create_scheduler' (fa46e741-2ac9-469e-a90b-4adaf88e9337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:30:09.251303 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] Flow 'volume_create_scheduler' (6d9d76aa-79a6-4b29-a001-5a1b8a04acb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:30:09.256337 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6461763d-e970-497c-b131-95670faf3ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:30:09.260178 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6461763d-e970-497c-b131-95670faf3ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(17944f37-6b83-4f7a-bf26-ed1a4c4209eb),volume_id=17944f37-6b83-4f7a-bf26-ed1a4c4209eb,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:30:09.263586 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2483204a-c49b-4096-9da1-d98db6e344ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:30:09.271754 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:30:09.285792 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:30:09.286158 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:30:09.286530 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:30:09.286915 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:30:09.287262 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:30:09.287612 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] Filtering removed all hosts for the request with volume ID '17944f37-6b83-4f7a-bf26-ed1a4c4209eb'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:30:09.287958 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] Filtering removed all hosts for the request with volume ID '17944f37-6b83-4f7a-bf26-ed1a4c4209eb'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:30:09.288437 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:30:09.288862 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] Creating message record for request_id = req-c82c0565-113a-4220-9388-4d45a70db682 Sep 24 21:30:09.295170 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:30:09.295488 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] Setting Volume 17944f37-6b83-4f7a-bf26-ed1a4c4209eb to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:30:09.305660 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2483204a-c49b-4096-9da1-d98db6e344ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:30:09.308884 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-c82c0565-113a-4220-9388-4d45a70db682 tempest-VolumesExtendTest-458953070 None] Flow 'volume_create_scheduler' (6d9d76aa-79a6-4b29-a001-5a1b8a04acb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:30:12.377082 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] Flow 'volume_create_scheduler' (86b8fb1e-72d3-4f44-910c-52f3dc3ef6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:30:12.382139 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (45d2d576-8548-4ec7-85a6-063656a5fbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:30:12.385975 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (45d2d576-8548-4ec7-85a6-063656a5fbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b3f50080-b394-44a1-a189-86c29b25e2f1),volume_id=b3f50080-b394-44a1-a189-86c29b25e2f1,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:30:12.389366 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b99cbe94-a1e8-42f2-b661-d1a31a725ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:30:12.397518 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:30:12.411408 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:30:12.411776 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:30:12.412862 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:30:12.413283 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:30:12.413824 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:30:12.414181 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] Filtering removed all hosts for the request with volume ID 'b3f50080-b394-44a1-a189-86c29b25e2f1'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:30:12.414546 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] Filtering removed all hosts for the request with volume ID 'b3f50080-b394-44a1-a189-86c29b25e2f1'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:30:12.415033 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:30:12.415460 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] Creating message record for request_id = req-275a71ed-9aa1-473f-8965-5ff1705f9aef Sep 24 21:30:12.423841 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:30:12.424189 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] Setting Volume b3f50080-b394-44a1-a189-86c29b25e2f1 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:30:12.434955 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b99cbe94-a1e8-42f2-b661-d1a31a725ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:30:12.438051 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-275a71ed-9aa1-473f-8965-5ff1705f9aef tempest-VolumesSnapshotNegativeTestJSON-983630505 None] Flow 'volume_create_scheduler' (86b8fb1e-72d3-4f44-910c-52f3dc3ef6ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:30:36.576335 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:DELETE=5,cinder:SELECT=54,cinder:UPDATE=11,cinder:INSERT=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:31:07.832239 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-07067fe7-c496-45dd-95fe-aeab334e12c3 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:31:16.580285 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:31:46.588784 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:32:07.836993 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-195af492-6b2f-4702-b519-9519b0fd5665 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:32:26.596920 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:33:06.600414 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:33:07.834343 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-3449529a-8e96-4b0e-a9f3-141536a67e64 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:33:36.611756 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:34:06.622201 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:34:07.831263 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-dce160ab-afe9-441f-9acf-65f2ece897e4 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:34:36.632837 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:35:06.643089 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:35:07.836041 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-bebff0ac-caf2-492a-b885-d794eb73477a None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:35:36.655780 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:36:06.666651 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:36:07.833980 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-b2e8b3c6-fedf-4f0e-af2a-97509db3f459 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:36:36.675527 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:37:06.684291 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:37:07.829594 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-a55cdcbd-77bb-4306-b3f6-55616aa60b1c None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:37:36.692870 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:06.701021 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:38:07.837472 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-7df3f423-ab99-4347-967c-a918a41b7276 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:38:36.710026 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:39:06.718901 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:39:07.834894 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-c9a6d78c-110d-43fa-b2e7-d44b105ac430 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:39:46.725126 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:40:07.839898 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-ec0d2938-2ec2-456f-8d33-d472b69a6b0a None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:40:16.736725 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:40:56.742251 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:41:26.753607 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:41:56.763524 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:42:07.847600 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-cd509525-5b4f-448c-b1ea-7322b4e8f86e None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:42:36.764819 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:43:06.774853 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:43:07.852362 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-5587eb3b-e29d-4aa8-8e72-3def473a4cea None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:43:46.779901 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:44:07.858021 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-d5ba73fc-6369-4e78-ab14-25be2154b250 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:44:16.789500 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:44:46.804567 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:45:07.854080 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-d2ea9462-9256-478d-a6cf-659b34f36524 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:45:16.814548 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:45:46.824050 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:46:07.859183 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-5a3340b0-e74c-4bf6-9a52-abefcd3efe01 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:46:16.834780 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:46:46.842563 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:46:51.853255 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] Flow 'volume_create_scheduler' (42b41389-9720-4f72-8d41-900ba7d7ef2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:46:51.857323 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (289e3330-4474-4df2-8399-5274dbe88e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:46:51.861168 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (289e3330-4474-4df2-8399-5274dbe88e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(36aaef70-3c22-403c-8f80-05f403f11484),volume_id=36aaef70-3c22-403c-8f80-05f403f11484,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:46:51.865184 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (022731df-7511-4d6c-a5a4-9f4c9eb6aedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:46:51.873936 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:46:51.887738 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:46:51.888107 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:46:51.888459 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:46:51.888810 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:46:51.889152 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:46:51.889497 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] Filtering removed all hosts for the request with volume ID '36aaef70-3c22-403c-8f80-05f403f11484'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:46:51.889837 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] Filtering removed all hosts for the request with volume ID '36aaef70-3c22-403c-8f80-05f403f11484'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:46:51.890318 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:46:51.890765 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] Creating message record for request_id = req-5e0ba19c-4c3a-4390-8326-e1254e27b011 Sep 24 21:46:51.898603 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:46:51.899047 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] Setting Volume 36aaef70-3c22-403c-8f80-05f403f11484 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:46:51.908830 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (022731df-7511-4d6c-a5a4-9f4c9eb6aedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:46:51.913065 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-5e0ba19c-4c3a-4390-8326-e1254e27b011 tempest-ServerActionsTestJSON-409908010 None] Flow 'volume_create_scheduler' (42b41389-9720-4f72-8d41-900ba7d7ef2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:47:07.858531 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-7c9a21ee-d7af-4f4d-a516-e3f1c233b862 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:47:16.852146 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=5,cinder:SELECT=20,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:47:56.861027 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:07.863659 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-27b48e19-c88e-4bbf-9f7a-6ee91f0b4937 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:48:26.874478 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:48:33.915811 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] Flow 'volume_create_scheduler' (dc395446-f39a-4670-94e5-29d1b650c4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:48:33.920065 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (76d9b58b-b6e3-4108-bc13-0069a61b2205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:48:33.923914 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (76d9b58b-b6e3-4108-bc13-0069a61b2205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a283afad-4dd1-4b14-9080-db407cd6bf35),volume_id=a283afad-4dd1-4b14-9080-db407cd6bf35,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:48:33.928223 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (27c76d22-8c5e-4ee2-bf05-d986fe5fa689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:48:33.936118 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:48:33.950744 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:48:33.951113 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:48:33.951468 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:48:33.951815 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:48:33.952155 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:48:33.952522 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] Filtering removed all hosts for the request with volume ID 'a283afad-4dd1-4b14-9080-db407cd6bf35'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:48:33.952839 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] Filtering removed all hosts for the request with volume ID 'a283afad-4dd1-4b14-9080-db407cd6bf35'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:48:33.953311 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:48:33.953730 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] Creating message record for request_id = req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a Sep 24 21:48:33.961801 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:48:33.962177 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] Setting Volume a283afad-4dd1-4b14-9080-db407cd6bf35 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:48:33.972483 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (27c76d22-8c5e-4ee2-bf05-d986fe5fa689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:48:33.975573 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-625e5fed-7f77-4c9b-a7d8-cfe0f5dbdd4a tempest-TestMinimumBasicScenario-1066335558 None] Flow 'volume_create_scheduler' (dc395446-f39a-4670-94e5-29d1b650c4e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:48:56.884201 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=5,cinder:SELECT=18,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:49:07.860666 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-46baf829-547b-4911-9082-8e042e6115d9 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:49:11.958592 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] Flow 'volume_create_scheduler' (479ec9f8-73cc-4d4b-a9ce-ed9d2058e280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:49:11.963128 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1d81a53c-62b3-4898-9042-01f648c6a1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:49:11.966939 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1d81a53c-62b3-4898-9042-01f648c6a1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ce856fd7-d06e-47c0-a8b3-efef818a8fe8),volume_id=ce856fd7-d06e-47c0-a8b3-efef818a8fe8,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:49:11.970305 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3d4f191d-8eec-4da2-a213-351bec6f403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 21:49:11.978185 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 21:49:11.991826 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 21:49:11.992190 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 21:49:11.992545 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:49:11.992891 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:49:11.993230 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 21:49:11.993572 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] Filtering removed all hosts for the request with volume ID 'ce856fd7-d06e-47c0-a8b3-efef818a8fe8'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 21:49:11.993909 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] Filtering removed all hosts for the request with volume ID 'ce856fd7-d06e-47c0-a8b3-efef818a8fe8'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 21:49:11.994380 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 21:49:11.994819 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] Creating message record for request_id = req-3ba443c7-eeca-49ec-bdec-107f242c7463 Sep 24 21:49:12.000953 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 21:49:12.001339 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] Setting Volume ce856fd7-d06e-47c0-a8b3-efef818a8fe8 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 21:49:12.011666 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3d4f191d-8eec-4da2-a213-351bec6f403f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 21:49:12.014760 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-3ba443c7-eeca-49ec-bdec-107f242c7463 tempest-TestMinimumBasicScenario-1066335558 None] Flow 'volume_create_scheduler' (479ec9f8-73cc-4d4b-a9ce-ed9d2058e280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 21:49:36.894763 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:50:07.857428 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-d5131983-8225-4cbb-aa60-ad12647ad04f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:50:16.892391 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:50:46.903639 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:51:07.862482 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-8871ebff-45b2-4d13-b8df-5ef3ca427b85 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:51:16.912035 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:51:46.920726 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:52:07.868594 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-194e6ea8-935c-4f55-8ec6-170ece18227a None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:52:16.928942 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=8 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:52:46.940676 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:53:07.873036 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-078e8220-e5d9-4ae3-b109-f36bf35072aa None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:53:16.951480 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:53:46.962277 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:54:07.877264 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-17c9f2f2-713e-42ef-adf9-f332073822f1 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:54:16.971794 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:54:46.980437 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:55:07.883547 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-e5b4de9e-45bb-42bb-8d4f-25496a05786a None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:55:16.990585 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:55:47.000004 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:56:07.879712 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-c827933e-c570-403f-87b9-ede32f332e62 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:56:17.011013 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:56:47.020114 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:57:07.889099 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-1bf54fd2-0f5f-4c2c-bab8-680b7b529f51 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:57:17.029588 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:57:57.032029 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:58:07.883823 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-8611da01-32e6-49c6-911c-69142511a417 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:58:27.042583 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:58:57.057637 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 21:59:07.879902 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-1f2c2b8b-fdf4-49b7-8c95-ed0d8a9850a8 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 21:59:37.060313 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:00:07.075741 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:00:07.885569 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-996b85fe-89f8-4be4-be70-8536cf2f28b0 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:00:37.083757 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:01:07.092469 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:01:07.880475 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-f099139d-f537-47a3-9c01-a813bdbd073f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:01:47.092244 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:02:07.886122 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-64ac5413-f690-4055-87b6-fa8216dbc998 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:02:27.101815 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:02:57.111011 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:03:07.891184 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-fa6a781e-0764-4e55-8e85-b57902799777 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:03:27.126441 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:03:49.765280 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] Flow 'volume_create_scheduler' (d484e42f-df10-433c-aa80-29bfcf3fca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 22:03:49.769365 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (43e78770-00eb-4eca-94a3-95c6064670c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 22:03:49.773224 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (43e78770-00eb-4eca-94a3-95c6064670c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=4c30e8e9-8fb2-4377-83f1-98322cb17799,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(d7cc5080-fb08-4468-8979-33309f40eb91),volume_id=d7cc5080-fb08-4468-8979-33309f40eb91,volume_properties=VolumeProperties,volume_type=VolumeType(291311aa-f438-45f1-8d44-6f2e6ad780f8))}' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 22:03:49.776606 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f8a2881d-7adb-4676-80ba-42dc692fdb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 24 22:03:49.784482 ncdv-master-1 cinder-scheduler[132381]: DEBUG oslo_db.sqlalchemy.engines [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132381) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 22:03:49.798598 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.host_manager [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] volume service is down. (host: ncdv-master-1@ceph) Sep 24 22:03:49.798971 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] Starting with 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 24 22:03:49.799328 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 22:03:49.799682 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] Filter CapacityFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 22:03:49.800029 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132381) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 24 22:03:49.800385 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.base_filter [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] Filtering removed all hosts for the request with volume ID 'd7cc5080-fb08-4468-8979-33309f40eb91'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132381) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 24 22:03:49.800728 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.scheduler.base_filter [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] Filtering removed all hosts for the request with volume ID 'd7cc5080-fb08-4468-8979-33309f40eb91'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 24 22:03:49.801215 ncdv-master-1 cinder-scheduler[132381]: WARNING cinder.scheduler.filter_scheduler [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] No weighed backend found for volume with properties: {'id': '291311aa-f438-45f1-8d44-6f2e6ad780f8', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-24T20:40:15.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 24 22:03:49.801639 ncdv-master-1 cinder-scheduler[132381]: INFO cinder.message.api [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] Creating message record for request_id = req-331a5e3d-45d8-4816-a969-659bebb914e9 Sep 24 22:03:49.807961 ncdv-master-1 cinder-scheduler[132381]: ERROR cinder.scheduler.flows.create_volume [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 24 22:03:49.808390 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.volume.flows.common [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] Setting Volume d7cc5080-fb08-4468-8979-33309f40eb91 to error due to: No valid backend was found. No weighed backends available {{(pid=132381) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 24 22:03:49.819001 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f8a2881d-7adb-4676-80ba-42dc692fdb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132381) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 24 22:03:49.822087 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.manager [None req-331a5e3d-45d8-4816-a969-659bebb914e9 tempest-TestShelveInstance-654352874 None] Flow 'volume_create_scheduler' (d484e42f-df10-433c-aa80-29bfcf3fca9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132381) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 24 22:03:57.141430 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=5,cinder:SELECT=20,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:04:07.896079 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-0784670c-66c6-48c5-8c1e-c783a4697cb2 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:04:37.133448 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:05:07.892200 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-83d1c466-55a4-4348-a71f-9a5684618b05 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:05:17.137803 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:05:47.153053 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:06:07.888511 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-042d00fe-2413-44ce-b9c4-49de79c27c40 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:06:17.161557 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:06:57.165431 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:07:07.894518 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-e1903b3b-b16a-44b6-8b9e-11df8d87b0a6 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:07:27.177622 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:07:57.189226 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:08:07.899317 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-93dc05da-45bc-48c3-89ee-db6704125872 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:08:27.199225 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:08:57.210024 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:09:07.895924 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-51c1339e-bccb-45d6-ab55-a0490df5a982 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:09:27.218645 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:10:07.224457 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:10:07.900425 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-9a9ba107-9741-4fc4-902e-903ff8fda044 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:10:37.235241 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:11:07.249279 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:11:07.906415 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-689b6d21-7d1f-4165-956d-c453a066a209 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:11:37.255566 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=8 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:12:07.265346 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:12:07.903269 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-ad8beda6-554a-49ac-8458-e954e56a3b42 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:12:37.276542 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:13:07.288766 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:13:07.908377 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-d88f4e1a-f764-4fed-94dd-e890a2c70a9a None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:13:37.299531 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:14:07.307953 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:14:07.913896 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-7be2202d-5436-4a36-95ae-7ffdd8307e55 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:14:37.317745 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:15:07.329444 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:15:07.920215 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-2c915aae-8cef-4384-aa42-423240f60bd7 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:15:37.340882 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:16:07.349912 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:16:07.917683 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-cc9ba6e6-319e-45ea-9f73-d463da0408ab None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:16:37.364484 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:17:07.372133 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 22:17:07.922269 ncdv-master-1 cinder-scheduler[132381]: DEBUG cinder.scheduler.host_manager [None req-59880e73-135e-440c-88aa-311775c15e6c None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132381) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 24 22:17:37.380236 ncdv-master-1 cinder-scheduler[132381]: DEBUG dbcounter [-] [132381] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132381) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}