-- Logs begin at Sat 2022-09-03 20:01:17 UTC, end at Sat 2022-09-03 22:07:49 UTC. -- Sep 03 20:39:32.600259 ncdv-master-1 systemd[1]: Started Devstack devstack@c-sch.service. Sep 03 20:39:36.014254 ncdv-master-1 cinder-scheduler[132453]: INFO dbcounter [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] Registered counter for database cinder Sep 03 20:39:36.046984 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:39:36.054589 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writer thread running {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:39:36.459843 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.rpc [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 03 20:39:36.469660 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.rpc [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Sep 03 20:39:36.477302 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:39:36.482383 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.rpc [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Sep 03 20:39:36.487033 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.rpc [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] Automatically selected cinder-backup RPC version 2.3 as minimum service version. Sep 03 20:39:36.491812 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.rpc [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 20:39:36.502119 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.rpc [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 20:39:36.510525 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:39:36.542460 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_concurrency.lockutils [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] Acquiring lock "singleton_lock" {{(pid=132453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 20:39:36.542842 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_concurrency.lockutils [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] Acquired lock "singleton_lock" {{(pid=132453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 20:39:36.543323 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_concurrency.lockutils [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] Releasing lock "singleton_lock" {{(pid=132453) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 20:39:36.543780 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] ******************************************************************************** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 20:39:36.544184 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] Configuration options gathered from: {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 20:39:36.544512 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 20:39:36.544934 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 20:39:36.545347 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] ================================================================================ {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 20:39:36.545824 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] allocated_capacity_weight_multiplier = -1.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.546224 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] allow_availability_zone_fallback = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.546632 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] allow_compression_on_image_upload = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.547003 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] allowed_direct_url_schemes = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.547371 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] api_rate_limit = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.547755 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] auth_strategy = keystone {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.548124 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] az_cache_duration = 3600 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.548436 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backdoor_port = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.548743 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backdoor_socket = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.549128 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_availability_zone = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.549502 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backup_api_class = cinder.backup.api.API {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.549893 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.551202 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backup_name_template = backup-%s {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.551202 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backup_use_same_host = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.551202 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backup_use_temp_snapshot = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.551429 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] capacity_weight_multiplier = 1.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.551779 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] chap_password = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.552155 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] chap_username = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.552533 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.552993 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_internal_tenant_project_id = 1e040b2fca724c58a2660441a72cd350 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.553567 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_internal_tenant_user_id = 133a1ff64e224593be467eb7c27cbb09 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.554012 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cloned_volume_same_az = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.554244 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] compression_format = gzip {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.554621 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] compute_api_class = cinder.compute.nova.API {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.554984 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] config_dir = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.555323 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.556184 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] config_source = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.556558 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.561027 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] control_exchange = openstack {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.561027 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] debug = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.561027 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] default_availability_zone = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.561027 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] default_group_type = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.561027 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.561418 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] default_volume_type = ceph {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.561418 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] driver_client_cert = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.561418 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] driver_client_cert_key = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.561752 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] driver_data_namespace = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.563118 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] driver_ssl_cert_path = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.563118 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] driver_ssl_cert_verify = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.563118 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] driver_use_ssl = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.563118 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] enable_force_upload = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.563510 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] enable_new_services = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.564182 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] enable_unsupported_driver = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.564347 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] enabled_backends = ['ceph'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.564582 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] enforce_multipath_for_image_xfer = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.565258 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] filter_function = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.565425 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_api_insecure = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.566260 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_api_servers = ['http://10.222.0.16/image'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.566260 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_api_ssl_compression = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.566599 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_ca_certificates_file = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.566753 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_catalog_info = image:glance:publicURL {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.567337 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_certfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.568056 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.568056 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_keyfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.598760 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_num_retries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.599325 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_request_timeout = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.599701 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] goodness_function = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.600164 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] graceful_shutdown_timeout = 5 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.600558 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] group_api_class = cinder.group.api.API {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.600956 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] host = ncdv-master-1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.602394 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iet_conf = /etc/iet/ietd.conf {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.603455 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_compress_on_upload = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.603840 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_conversion_address_space_limit = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.604214 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_conversion_cpu_limit = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.606919 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.606919 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_conversion_disable = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.607162 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_upload_use_cinder_backend = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.607560 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_upload_use_internal_tenant = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.607934 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_volume_cache_enabled = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.609964 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_volume_cache_max_count = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.629531 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_volume_cache_max_size_gb = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.630329 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] instance_format = [instance: %(uuid)s] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.630329 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.630691 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iscsi_iotype = fileio {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.631072 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iscsi_secondary_ip_addresses = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.631841 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iscsi_target_flags = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.632232 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iscsi_write_cache = on {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.638968 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iser_helper = tgtadm {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.640130 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iser_ip_address = 10.222.0.16 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.643514 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iser_port = 3260 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.644066 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.644474 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_config_append = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.646500 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.646912 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_dir = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.647344 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_file = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.647711 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_options = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.648233 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_rotate_interval = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.648633 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_rotate_interval_type = days {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.649107 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_rotation_type = none {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.650053 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.652304 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.652304 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.652304 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.652655 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.654774 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] max_age = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.655180 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] max_logfile_count = 30 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.655709 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] max_logfile_size_mb = 200 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.656202 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] max_over_subscription_ratio = 20.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.656590 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] message_reap_interval = 86400 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.657052 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] message_ttl = 2592000 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.657432 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] monkey_patch = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.657809 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] monkey_patch_modules = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.658245 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] my_ip = 10.222.0.16 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.658620 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] no_snapshot_gb_quota = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.658999 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] num_iser_scan_tries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.659423 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] num_shell_tries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.659792 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] num_volume_device_scan_tries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.660164 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nvmet_ns_id = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.660583 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nvmet_port_id = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.660999 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] osapi_max_limit = 1000 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.661369 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] osapi_volume_ext_list = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.661814 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.662827 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] osapi_volume_listen = 0.0.0.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.663493 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] osapi_volume_listen_port = 8776 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.663872 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] osapi_volume_use_ssl = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.664260 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] osapi_volume_workers = 2 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.665760 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] per_volume_size_limit = -1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.666141 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] periodic_fuzzy_delay = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.666525 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] periodic_interval = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.666943 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] project_id_regex = [0-9a-f\-]+ {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.667309 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] public_endpoint = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.667711 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] publish_errors = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.668113 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_backup_gigabytes = 1000 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.669287 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_backups = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.669660 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_consistencygroups = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.670926 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.671300 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_gigabytes = 1000 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.671687 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_groups = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.672050 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_snapshots = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.672430 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_volumes = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.672934 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] rate_limit_burst = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.673307 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] rate_limit_except_level = CRITICAL {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.673673 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] rate_limit_interval = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.674036 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] replication_device = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.674398 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] report_discard_supported = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.675293 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] report_interval = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.675783 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] reservation_clean_interval = 86400 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.676100 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] reservation_expire = 86400 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.676466 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] reserved_percentage = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.676927 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.677343 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.677725 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] rpc_response_timeout = 120 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.678088 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] run_external_periodic_tasks = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.678605 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_default_filters = ['AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.678991 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_default_weighers = ['CapacityWeigher'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.679363 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_driver = cinder.scheduler.filter_scheduler.FilterScheduler {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.679726 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_driver_init_wait_time = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.680094 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_host_manager = cinder.scheduler.host_manager.HostManager {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.680468 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_json_config_location = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.681488 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.681858 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_max_attempts = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.682417 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_weight_handler = cinder.scheduler.weights.OrderedHostWeightHandler {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.682795 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scst_target_driver = iscsi {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.683153 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scst_target_iqn_name = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.683510 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_down_time = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.683882 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] snapshot_name_template = snapshot-%s {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.684242 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] snapshot_same_host = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.684601 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] split_loggers = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.685882 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] state_path = /opt/stack/data/cinder {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.686280 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] storage_availability_zone = nova {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.686664 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] storage_protocol = iSCSI {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.687043 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] syslog_log_facility = LOG_USER {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.687426 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] target_helper = lioadm {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.687883 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] target_ip_address = 10.222.0.16 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.688254 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] target_port = 3260 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.688764 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.689164 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] target_protocol = iscsi {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.689521 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] trace_flags = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.689942 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] transfer_api_class = cinder.transfer.api.API {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.690321 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] transport_url = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.690704 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] until_refresh = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.691070 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_chap_auth = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.691431 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_default_quota_class = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.691791 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_eventlog = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.692149 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_journal = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.692508 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_json = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.692869 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_multipath_for_image_xfer = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.693255 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_stderr = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.693613 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_syslog = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.694843 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] verify_glance_signatures = enabled {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.695242 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_api_class = cinder.volume.api.API {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.695603 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_backend_name = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.695979 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_clear = zero {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.697037 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_clear_ionice = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.697422 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_clear_size = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.697783 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.698149 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_copy_bps_limit = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.698517 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_dd_blocksize = 1M {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.698994 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.699371 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_name_template = volume-%s {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.699738 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_number_multiplier = -1.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.700113 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_usage_audit_period = month {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.700551 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.700938 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] watch_log_file = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.701340 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.701716 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.702111 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_concurrency.disable_process_locking = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.702495 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.702928 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.703304 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.703670 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.704084 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.704489 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.704879 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.admin_password = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.705294 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.admin_tenant_name = admin {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.705692 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.admin_token = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.706057 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.admin_user = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.706434 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_admin_prefix = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.706811 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.707540 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_port = 35357 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.709689 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_protocol = https {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.710138 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_section = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.710477 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_type = password {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.710906 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_uri = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.711272 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_version = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.711637 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.cache = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.712543 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.713177 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.certfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.713629 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.delay_auth_decision = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.714025 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.714396 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.http_connect_timeout = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.714760 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.715120 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.identity_uri = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.715486 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.include_service_catalog = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.715864 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.insecure = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.716234 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.interface = public {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.717901 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.keyfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.718312 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.719646 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.720033 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.720412 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.720836 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.721232 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.721704 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.722081 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.722483 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.722859 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.region_name = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.723249 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.723618 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.service_token_roles_required = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.723983 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.service_type = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.724342 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.token_cache_time = 300 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.724711 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.www_authenticate_uri = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.725781 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.backend = dogpile.cache.null {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.726326 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.backend_argument = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.726841 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.config_prefix = cache.oslo {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.728231 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.dead_timeout = 60.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.728776 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.debug_cache_backend = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.729321 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.enable_retry_client = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.729943 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.enable_socket_keepalive = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.730458 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.enabled = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.730977 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.expiration_time = 600 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.731974 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.hashclient_retry_attempts = 2 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.732516 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.hashclient_retry_delay = 1.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.733079 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_dead_retry = 300 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.733605 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_password = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.734123 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.734653 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.735185 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_pool_maxsize = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.735710 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.736228 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_sasl_enabled = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.736839 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.737375 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_socket_timeout = 1.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.737926 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_username = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.738445 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.proxies = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.738971 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.retry_attempts = 2 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.740310 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.retry_delay = 0.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.740949 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.socket_keepalive_count = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.741489 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.socket_keepalive_idle = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.742149 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.socket_keepalive_interval = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.743187 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.tls_allowed_ciphers = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.743745 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.tls_cafile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.744424 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.tls_certfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.745003 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.tls_enabled = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.745534 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.tls_keyfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.746078 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] coordination.backend_url = etcd3+http://10.222.0.16:2379 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.746637 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.backend = sqlalchemy {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.747174 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.connection = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.747694 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.connection_debug = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.748238 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.connection_parameters = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.748751 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.connection_recycle_time = 3600 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.749377 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.connection_trace = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.749894 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.db_inc_retry_interval = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.750416 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.db_max_retries = 20 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.751028 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.db_max_retry_interval = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.752357 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.db_retry_interval = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.758530 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.max_overflow = 50 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.759747 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.max_pool_size = 5 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.760286 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.max_retries = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.761021 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.mysql_enable_ndb = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.761692 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.763108 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.pool_timeout = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.763694 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.retry_interval = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.765076 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.slave_connection = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.766417 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.sqlite_synchronous = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.766964 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.use_db_reconnect = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.767534 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.enforce_new_defaults = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.768051 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.enforce_scope = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.768633 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.policy_default_rule = default {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.769248 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.769793 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.policy_file = policy.yaml {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.771750 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.772418 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.775183 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.775820 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.776362 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.776952 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.connection_string = messaging:// {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.777491 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.enabled = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.778032 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.es_doc_type = notification {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.778555 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.es_scroll_size = 10000 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.779093 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.es_scroll_time = 2m {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.779618 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.filter_error_trace = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.780167 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.hmac_keys = SECRET_KEY {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.780696 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.sentinel_service_name = mymaster {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.781275 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.socket_timeout = 0.1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.781802 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.trace_sqlalchemy = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.782436 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] os_brick.lock_path = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.782986 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] privsep_osbrick.capabilities = [21] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.783503 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] privsep_osbrick.group = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.784153 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] privsep_osbrick.helper_command = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.784681 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.785315 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.786005 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] privsep_osbrick.user = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.786550 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.788396 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_sys_admin.group = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.789016 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_sys_admin.helper_command = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.789735 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.790320 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.790845 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_sys_admin.user = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.791375 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.auth_section = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.791942 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.auth_type = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.792559 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.cafile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.793106 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.certfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.793648 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.collect_timing = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.794210 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.insecure = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.794746 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.keyfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.795266 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.send_service_user_token = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.795793 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.split_loggers = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.796363 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.timeout = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.796958 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.backend_availability_zone = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.797512 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.chap_password = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.798430 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.chap_username = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.798430 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.798660 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.driver_client_cert = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.799235 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.driver_client_cert_key = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.799607 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.driver_data_namespace = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.799993 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.800349 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.800722 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.driver_use_ssl = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.802629 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.enable_unsupported_driver = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.803184 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.803720 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.filter_function = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.804252 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.goodness_function = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.804786 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.805362 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.805924 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.806624 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.807157 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.807686 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.808233 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iscsi_iotype = fileio {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.808781 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.809329 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iscsi_target_flags = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.810764 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iscsi_write_cache = on {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.811323 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iser_helper = tgtadm {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.812066 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iser_ip_address = 10.222.0.16 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.812714 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iser_port = 3260 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.813286 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.813843 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.814366 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.814896 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.num_shell_tries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.815434 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.815953 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.816479 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.nvmet_port_id = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.817025 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.replication_device = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.818210 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.report_discard_supported = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.818758 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.reserved_percentage = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.819322 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.scst_target_driver = iscsi {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.819846 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.scst_target_iqn_name = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.820395 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.storage_protocol = iSCSI {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.822001 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.target_helper = tgtadm {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.822767 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.target_ip_address = 10.222.0.16 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.823317 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.target_port = 3260 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.823913 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.824447 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.target_protocol = iscsi {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.824989 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.trace_flags = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.825520 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.unique_fqdn_network = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.826073 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.use_chap_auth = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.826612 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.827132 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volume_backend_name = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.827664 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volume_clear = zero {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.828219 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volume_clear_ionice = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.828747 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volume_clear_size = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.829324 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.829856 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.832646 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.832646 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.832646 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_reports.file_event_handler = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.832646 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.832646 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_reports.log_dir = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.832646 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.833617 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.834134 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.834904 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.835500 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.836017 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.836625 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.837951 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.838488 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.839019 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.839653 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.840190 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.840737 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.841291 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.841913 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.842553 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.843082 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.843703 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.844307 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.844835 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.845385 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.845919 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.846443 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.847727 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.848264 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.848814 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.ssl = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.850297 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.850843 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.851375 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.851916 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.852501 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.ssl_version = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.853174 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_notifications.driver = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.853805 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_notifications.retry = -1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.854370 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.854886 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_notifications.transport_url = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.855541 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.auth_section = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.856132 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.auth_type = password {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.856675 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.857219 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.certfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.857749 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.collect_timing = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.858269 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.insecure = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.858826 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.interface = public {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.859385 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.keyfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.859925 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.region_name = RegionOne {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.860457 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.split_loggers = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.861060 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.timeout = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.861593 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.token_auth_url = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.862053 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] ******************************************************************************** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 20:39:36.862629 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] Full set of CONF: {{(pid=132453) _wait_for_exit_or_signal /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:362}} Sep 03 20:39:36.863066 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] ******************************************************************************** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 20:39:36.863504 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] Configuration options gathered from: {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 20:39:36.864043 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 20:39:36.864499 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 20:39:36.865066 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] ================================================================================ {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 20:39:36.865591 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] allocated_capacity_weight_multiplier = -1.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.866028 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] allow_availability_zone_fallback = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.866461 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] allow_compression_on_image_upload = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.866907 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] allowed_direct_url_schemes = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.867423 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] api_rate_limit = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.867858 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] auth_strategy = keystone {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.868524 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] az_cache_duration = 3600 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.869012 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backdoor_port = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.869460 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backdoor_socket = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.869902 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_availability_zone = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.870340 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backup_api_class = cinder.backup.api.API {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.870769 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.871205 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backup_name_template = backup-%s {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.871631 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backup_use_same_host = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.872069 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backup_use_temp_snapshot = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.872498 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] capacity_weight_multiplier = 1.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.872982 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] chap_password = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.873422 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] chap_username = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.874497 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.874958 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_internal_tenant_project_id = 1e040b2fca724c58a2660441a72cd350 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.875404 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_internal_tenant_user_id = 133a1ff64e224593be467eb7c27cbb09 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.875836 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cloned_volume_same_az = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.876273 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] compression_format = gzip {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.876702 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] compute_api_class = cinder.compute.nova.API {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.877177 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] config_dir = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.877624 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.878056 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] config_source = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.878479 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.878913 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] control_exchange = openstack {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.879357 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] debug = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.879795 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] default_availability_zone = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.880219 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] default_group_type = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.880680 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.881154 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] default_volume_type = ceph {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.881602 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] driver_client_cert = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.882049 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] driver_client_cert_key = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.882548 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] driver_data_namespace = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.883051 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] driver_ssl_cert_path = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.883551 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] driver_ssl_cert_verify = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.885192 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] driver_use_ssl = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.885713 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] enable_force_upload = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.886216 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] enable_new_services = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.886706 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] enable_unsupported_driver = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.887206 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] enabled_backends = ['ceph'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.887708 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] enforce_multipath_for_image_xfer = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.888250 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] filter_function = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.888775 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_api_insecure = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.889310 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_api_servers = ['http://10.222.0.16/image'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.889799 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_api_ssl_compression = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.890299 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_ca_certificates_file = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.890798 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_catalog_info = image:glance:publicURL {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.891306 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_certfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.891801 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.892304 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_keyfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.892799 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_num_retries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.893323 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] glance_request_timeout = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.893842 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] goodness_function = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.894346 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] graceful_shutdown_timeout = 5 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.894839 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] group_api_class = cinder.group.api.API {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.897160 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] host = ncdv-master-1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.897874 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iet_conf = /etc/iet/ietd.conf {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.898395 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_compress_on_upload = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.898898 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_conversion_address_space_limit = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.900043 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_conversion_cpu_limit = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.900552 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.901074 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_conversion_disable = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.901586 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_upload_use_cinder_backend = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.902091 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_upload_use_internal_tenant = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.902615 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_volume_cache_enabled = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.903427 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_volume_cache_max_count = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.903922 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] image_volume_cache_max_size_gb = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.904616 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] instance_format = [instance: %(uuid)s] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.905156 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.905650 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iscsi_iotype = fileio {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.906140 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iscsi_secondary_ip_addresses = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.906628 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iscsi_target_flags = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.907221 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iscsi_write_cache = on {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.907735 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iser_helper = tgtadm {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.908244 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iser_ip_address = 10.222.0.16 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.908732 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iser_port = 3260 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.909266 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.909755 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_config_append = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.910258 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.910753 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_dir = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.911252 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_file = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.911739 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_options = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.912226 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_rotate_interval = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.912724 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_rotate_interval_type = days {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.913296 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] log_rotation_type = none {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.913799 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.914302 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.914791 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.915316 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.915823 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.916329 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] max_age = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.916873 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] max_logfile_count = 30 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.917446 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] max_logfile_size_mb = 200 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.917949 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] max_over_subscription_ratio = 20.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.918450 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] message_reap_interval = 86400 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.918957 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] message_ttl = 2592000 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.919451 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] monkey_patch = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.919943 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] monkey_patch_modules = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.920467 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] my_ip = 10.222.0.16 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.920998 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] no_snapshot_gb_quota = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.921499 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] num_iser_scan_tries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.921993 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] num_shell_tries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.922479 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] num_volume_device_scan_tries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.923021 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nvmet_ns_id = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.923507 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nvmet_port_id = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.924002 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] osapi_max_limit = 1000 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.924510 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] osapi_volume_ext_list = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.925037 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.925541 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] osapi_volume_listen = 0.0.0.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.926036 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] osapi_volume_listen_port = 8776 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.926532 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] osapi_volume_use_ssl = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.927028 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] osapi_volume_workers = 2 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.927600 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] per_volume_size_limit = -1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.928085 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] periodic_fuzzy_delay = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.928581 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] periodic_interval = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.929135 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] project_id_regex = [0-9a-f\-]+ {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.930883 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] public_endpoint = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.931416 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] publish_errors = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.931914 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_backup_gigabytes = 1000 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.937908 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_backups = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.938463 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_consistencygroups = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.938991 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.939517 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_gigabytes = 1000 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.940029 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_groups = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.941294 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_snapshots = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.941806 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] quota_volumes = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.942433 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] rate_limit_burst = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.942959 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] rate_limit_except_level = CRITICAL {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.943458 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] rate_limit_interval = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.943949 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] replication_device = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.944538 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] report_discard_supported = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.945203 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] report_interval = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.945716 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] reservation_clean_interval = 86400 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.946723 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] reservation_expire = 86400 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.947230 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] reserved_percentage = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.948220 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.948713 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.949244 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] rpc_response_timeout = 120 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.949759 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] run_external_periodic_tasks = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.950620 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_default_filters = ['AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.951125 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_default_weighers = ['CapacityWeigher'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.951616 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_driver = cinder.scheduler.filter_scheduler.FilterScheduler {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.952123 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_driver_init_wait_time = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.952627 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_host_manager = cinder.scheduler.host_manager.HostManager {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.953171 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_json_config_location = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.953680 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.954176 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_max_attempts = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.954661 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scheduler_weight_handler = cinder.scheduler.weights.OrderedHostWeightHandler {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.955159 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scst_target_driver = iscsi {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.955643 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] scst_target_iqn_name = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.956143 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_down_time = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.956639 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] snapshot_name_template = snapshot-%s {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.957177 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] snapshot_same_host = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.957676 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] split_loggers = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.958288 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] state_path = /opt/stack/data/cinder {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.958782 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] storage_availability_zone = nova {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.959266 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] storage_protocol = iSCSI {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.960015 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] syslog_log_facility = LOG_USER {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.960558 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] target_helper = lioadm {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.961096 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] target_ip_address = 10.222.0.16 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.961586 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] target_port = 3260 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.962689 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.963183 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] target_protocol = iscsi {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.963669 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] trace_flags = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.964156 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] transfer_api_class = cinder.transfer.api.API {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.964673 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] transport_url = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.965185 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] until_refresh = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.965690 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_chap_auth = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.966177 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_default_quota_class = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.966659 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_eventlog = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.967235 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_journal = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.967720 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_json = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.968307 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_multipath_for_image_xfer = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.968793 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_stderr = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.969312 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] use_syslog = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.969828 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] verify_glance_signatures = enabled {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.970328 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_api_class = cinder.volume.api.API {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.970814 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_backend_name = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.971307 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_clear = zero {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.971801 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_clear_ionice = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.972296 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_clear_size = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.972800 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.973333 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_copy_bps_limit = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.973834 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_dd_blocksize = 1M {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.974317 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.974813 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_name_template = volume-%s {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.975313 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_number_multiplier = -1.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.975809 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volume_usage_audit_period = month {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.976293 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.976786 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] watch_log_file = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:39:36.977519 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.978074 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.978667 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_concurrency.disable_process_locking = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.979160 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.979670 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.980163 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.980663 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.981196 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.981700 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.982221 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.admin_password = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.982710 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.admin_tenant_name = admin {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.983199 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.admin_token = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.983699 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.admin_user = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.984185 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_admin_prefix = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.984704 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.985232 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_port = 35357 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.985723 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_protocol = https {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.986241 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_section = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.986737 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_type = password {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.987248 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_uri = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.987737 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.auth_version = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.988225 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.cache = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.988823 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.989373 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.certfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.989872 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.delay_auth_decision = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.990375 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.990877 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.http_connect_timeout = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.991375 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.991877 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.identity_uri = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.992385 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.include_service_catalog = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.993605 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.insecure = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.994104 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.interface = public {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.994595 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.keyfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.995101 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.995588 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.996083 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.996568 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.997098 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.997794 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.998359 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.998956 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.999451 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:36.999952 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.region_name = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.000448 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.000990 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.service_token_roles_required = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.001497 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.service_type = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.001986 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.token_cache_time = 300 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.002473 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] keystone_authtoken.www_authenticate_uri = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.002980 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.backend = dogpile.cache.null {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.003486 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.backend_argument = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.004126 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.config_prefix = cache.oslo {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.004644 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.dead_timeout = 60.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.005172 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.debug_cache_backend = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.005680 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.enable_retry_client = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.012284 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.enable_socket_keepalive = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.013181 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.enabled = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.013719 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.expiration_time = 600 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.014232 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.hashclient_retry_attempts = 2 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.014756 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.hashclient_retry_delay = 1.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.015713 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_dead_retry = 300 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.016235 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_password = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.016750 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.017309 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.017813 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_pool_maxsize = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.018313 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.018827 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_sasl_enabled = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.019329 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.019827 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_socket_timeout = 1.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.020323 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.memcache_username = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.020828 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.proxies = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.021368 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.retry_attempts = 2 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.021876 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.retry_delay = 0.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.022466 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.socket_keepalive_count = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.022976 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.socket_keepalive_idle = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.023471 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.socket_keepalive_interval = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.023974 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.tls_allowed_ciphers = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.024524 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.tls_cafile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.025045 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.tls_certfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.025556 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.tls_enabled = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.026062 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cache.tls_keyfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.026567 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] coordination.backend_url = etcd3+http://10.222.0.16:2379 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.027092 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.backend = sqlalchemy {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.027584 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.connection = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.028074 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.connection_debug = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.028580 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.connection_parameters = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.029124 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.connection_recycle_time = 3600 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.029634 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.connection_trace = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.030142 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.db_inc_retry_interval = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.030648 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.db_max_retries = 20 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.031138 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.db_max_retry_interval = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.031637 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.db_retry_interval = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.032129 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.max_overflow = 50 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.032867 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.max_pool_size = 5 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.033092 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.max_retries = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.033472 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.mysql_enable_ndb = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.033843 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.034195 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.pool_timeout = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.034552 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.retry_interval = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.034903 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.slave_connection = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.035252 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.sqlite_synchronous = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.035598 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] database.use_db_reconnect = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.035962 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.enforce_new_defaults = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.036313 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.enforce_scope = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.036658 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.policy_default_rule = default {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.037041 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.037392 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.policy_file = policy.yaml {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.037767 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.038122 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.038474 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.038826 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.039175 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.039532 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.connection_string = messaging:// {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.039876 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.enabled = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.040273 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.es_doc_type = notification {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.040627 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.es_scroll_size = 10000 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.041007 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.es_scroll_time = 2m {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.041356 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.filter_error_trace = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.041718 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.hmac_keys = SECRET_KEY {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.042249 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.sentinel_service_name = mymaster {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.042741 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.socket_timeout = 0.1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.043098 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] profiler.trace_sqlalchemy = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.043457 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] os_brick.lock_path = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.043845 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] privsep_osbrick.capabilities = [21] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.044197 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] privsep_osbrick.group = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.044549 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] privsep_osbrick.helper_command = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.044925 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.045274 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.045621 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] privsep_osbrick.user = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.045996 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.046349 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_sys_admin.group = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.046694 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_sys_admin.helper_command = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.047042 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.047390 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.047733 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] cinder_sys_admin.user = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.048096 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.auth_section = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.048491 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.auth_type = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.048834 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.cafile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.049205 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.certfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.049555 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.collect_timing = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.049919 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.insecure = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.050309 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.keyfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.050664 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.send_service_user_token = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.051011 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.split_loggers = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.051396 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] service_user.timeout = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.051769 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.backend_availability_zone = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.052115 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.chap_password = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.052501 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.chap_username = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.053008 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.053415 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.driver_client_cert = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.053759 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.driver_client_cert_key = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.054126 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.driver_data_namespace = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.054474 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.054986 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.055338 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.driver_use_ssl = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.056224 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.enable_unsupported_driver = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.056571 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.057196 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.filter_function = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.057559 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.goodness_function = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.057910 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.058263 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.058631 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.058982 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.059331 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.059678 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.060022 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iscsi_iotype = fileio {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.060366 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.060718 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iscsi_target_flags = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.061087 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iscsi_write_cache = on {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.061436 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iser_helper = tgtadm {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.061783 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iser_ip_address = 10.222.0.16 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.062134 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iser_port = 3260 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.062491 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.062968 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.063322 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.063670 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.num_shell_tries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.064018 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.064364 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.064712 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.nvmet_port_id = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.065090 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.replication_device = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.065436 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.report_discard_supported = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.065782 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.reserved_percentage = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.066126 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.scst_target_driver = iscsi {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.066487 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.scst_target_iqn_name = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.066830 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.storage_protocol = iSCSI {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.067434 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.target_helper = tgtadm {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.067784 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.target_ip_address = 10.222.0.16 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.068137 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.target_port = 3260 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.068487 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.068838 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.target_protocol = iscsi {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.069206 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.trace_flags = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.069554 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.unique_fqdn_network = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.069902 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.use_chap_auth = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.070250 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.070610 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volume_backend_name = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.070960 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volume_clear = zero {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.071943 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volume_clear_ionice = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.072290 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volume_clear_size = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.072637 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.073128 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.073480 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.073828 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.074184 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_reports.file_event_handler = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.074532 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.074876 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_reports.log_dir = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.075249 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.075595 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.075941 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.076286 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.076629 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.077191 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.077762 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.078110 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.078468 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.078809 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.079167 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.079511 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.079857 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.080202 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.080547 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.080909 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.081277 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.081642 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.081968 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.082312 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.082658 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.083018 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.083447 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.083793 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.084136 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.084744 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.ssl = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.085107 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.085447 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.085790 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.086139 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.086485 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_rabbit.ssl_version = {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.086859 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_notifications.driver = [] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.087218 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_notifications.retry = -1 {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.087739 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.088091 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] oslo_messaging_notifications.transport_url = **** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.089231 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.auth_section = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.089231 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.auth_type = password {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.089231 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.089453 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.certfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.089658 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.collect_timing = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.090135 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.insecure = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.090603 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.interface = public {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.091097 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.keyfile = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.091576 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.region_name = RegionOne {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.092049 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.split_loggers = False {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.092523 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.timeout = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.093021 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] nova.token_auth_url = None {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:39:37.093579 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.service [None req-739bfb01-4516-4131-bd79-c71c274a99aa None None] ******************************************************************************** {{(pid=132453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 20:39:37.095047 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.service [-] Starting cinder-scheduler node (version 20.1.0) Sep 03 20:39:37.096106 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.manager [None req-3b51a0cf-ae26-420a-b02d-67200181e8e2 None None] Initiating service 1 cleanup Sep 03 20:39:37.105877 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.manager [None req-3b51a0cf-ae26-420a-b02d-67200181e8e2 None None] Service 1 cleanup completed. Sep 03 20:39:37.106448 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-3b51a0cf-ae26-420a-b02d-67200181e8e2 None None] Creating RPC server for service cinder-scheduler {{(pid=132453) start /opt/stack/cinder/cinder/service.py:238}} Sep 03 20:39:37.112752 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.service [None req-3b51a0cf-ae26-420a-b02d-67200181e8e2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=132453) start /opt/stack/cinder/cinder/service.py:244}} Sep 03 20:39:38.967479 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-437a4fe8-1ccc-4ecf-85f8-fbf7e337dc6e None None] Received backup service update from ncdv-master-1: {'backend_state': False, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:39:41.322896 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ec6cbc65-bcb4-4fc2-9fef-439ceb7eceaf None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:39:41.344582 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ec6cbc65-bcb4-4fc2-9fef-439ceb7eceaf None None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 3, 20, 39, 41, 294323)} {{(pid=132453) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 03 20:39:51.331877 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=24,cinder:INSERT=1 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:40:22.205527 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:40:37.194596 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.periodic_task [None req-26451d31-acd6-49f5-85a0-68716aa87fee None None] Running periodic task SchedulerManager._clean_expired_messages {{(pid=132453) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Sep 03 20:40:37.200405 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-26451d31-acd6-49f5-85a0-68716aa87fee None None] Deleted 0 expired messages. Sep 03 20:40:37.200753 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_service.periodic_task [None req-26451d31-acd6-49f5-85a0-68716aa87fee None None] Running periodic task SchedulerManager._clean_expired_reservation {{(pid=132453) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Sep 03 20:40:37.974113 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-68d49cb3-0ec2-4ec5-a775-1ff400a51dae None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:40:52.215652 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:40:52.576579 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-d7209741-4cd9-4594-90d8-2197f41b892b None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:41:22.233526 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:41:37.971184 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-63267025-347a-4995-9b53-a6408964c968 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:41:52.241225 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:41:52.569140 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-d70a7fe9-55d2-4f99-9bd0-2520bf7d9508 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:42:22.251478 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:42:52.574880 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-a5598727-a4d5-438e-aad7-9a1ea83f716f None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:43:02.254903 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:43:32.265461 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:43:37.969656 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-1540238e-3f39-4fd4-a2bd-51c33327a3ff None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:43:52.564551 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-58048c83-4c13-46b4-bdd6-30f4e0aed6d3 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:44:02.274609 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:44:32.285588 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:44:37.974890 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-4ed1a658-e445-4272-9174-cee19e010c04 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:44:52.564083 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-65015e70-a8be-4669-a70a-351c25e4154f None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:45:02.295696 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:45:32.303238 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:45:37.981167 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-f608fc74-fee5-43e0-9d13-4e1a2e1a03e0 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:45:52.563035 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-5f707875-a330-413f-8d97-76e1a87db142 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:46:02.318313 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:46:32.328526 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:46:37.985977 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-9847c07a-79bc-4b7a-a9cd-53cb4d5b32b9 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:46:52.562513 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-5e59dfd8-05a3-48a1-b7e6-88126377dac2 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:47:02.337060 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:47:32.346199 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:47:37.982675 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-7fa4e283-f649-4dcd-ba92-73abe44c5d4d None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:47:52.568464 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-f7de7224-318a-4634-bde8-8c2ad20228a9 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:48:02.352884 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:48:37.989083 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-eae831f3-74e4-4727-a813-d5f21eea1e4e None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:48:42.363606 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:48:52.670183 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-78bb29c5-729b-4e6a-9aac-3a1488aeb57d None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:49:22.364263 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:37.988710 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-05ff3bb7-53f0-48a6-9ece-bb8b8eb0bd6a None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:49:52.665861 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-451ef03d-76c5-4606-9967-9d1f6204b650 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:50:02.370820 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:37.985970 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-41a65742-4344-4f57-bc17-165c94eb6461 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:50:42.372648 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:52.687992 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-dccff898-1060-4de4-87f2-5480577da6dd None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:51:12.387965 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:37.983181 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-d65a010b-daa7-4c64-9a0d-23021ce9aa5f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:51:52.404033 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:52.790201 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ff886955-9590-4682-adac-6192c5125c31 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:52:32.418942 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:37.983795 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-7a37d6cf-801e-4e8b-9244-361cd25dcb22 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:52:52.669236 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-0fc6e955-f3a4-464a-8394-efd2bde27363 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:53:12.418172 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:53:18.059432 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Flow 'volume_create_scheduler' (b4a517de-1bf2-4cbf-bf99-275fb1a0ca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:53:18.067148 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (754dfc1a-12ec-43ab-8bcf-150797be09a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:53:18.073278 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (754dfc1a-12ec-43ab-8bcf-150797be09a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(80e6d713-e5fc-4d1b-ae13-80868b12d778),volume_id=80e6d713-e5fc-4d1b-ae13-80868b12d778,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:53:18.079392 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2ee004e7-e9b1-4578-9d59-3da050976efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:53:18.089925 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:53:18.128700 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 3, 20, 52, 52, 663668)} {{(pid=132453) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 03 20:53:18.129783 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Starting with 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 20:53:18.130297 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:53:18.130844 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (80e6d713-e5fc-4d1b-ae13-80868b12d778) {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Sep 03 20:53:18.131403 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 0, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 0, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:52:52.663668 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Sep 03 20:53:18.132597 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/398.8 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Sep 03 20:53:18.133223 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Filter CapacityFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:53:18.133784 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:53:18.134456 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 0, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 0, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:52:52.663668] {{(pid=132453) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 03 20:53:18.135225 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_weight [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Weigher CapacityWeigher returned, weigher value is {max: 398.8, min: 398.8} {{(pid=132453) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 03 20:53:18.135723 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132453) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 03 20:53:18.136493 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132453) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 03 20:53:18.137053 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:53:18.136665 {{(pid=132453) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 03 20:53:18.279857 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2ee004e7-e9b1-4578-9d59-3da050976efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:53:18.283398 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5020d6df-98c9-4d53-b4b0-0d661b3adb94 tempest-LiveMigrationTest-2111888872 None] Flow 'volume_create_scheduler' (b4a517de-1bf2-4cbf-bf99-275fb1a0ca8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:53:37.983774 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-fa497779-64b0-4a42-bca1-097f725c06e3 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:53:52.423719 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:22.401689 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Flow 'volume_create_scheduler' (2aa928bd-465a-4893-b634-9ebc6a1791ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:54:22.407601 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8b0990ee-dbad-4ca1-af49-702c0dce2e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:54:22.413085 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8b0990ee-dbad-4ca1-af49-702c0dce2e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7d6b5527-60b3-46e7-b592-f5108171cc0c),volume_id=7d6b5527-60b3-46e7-b592-f5108171cc0c,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:54:22.417431 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (110cf4db-46bf-41c2-a959-6fd2b2c92bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:54:22.427784 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:54:22.438091 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:22.462426 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 3, 20, 52, 52, 663668)} {{(pid=132453) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 03 20:54:22.463647 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Starting with 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 20:54:22.464519 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:54:22.465073 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (7d6b5527-60b3-46e7-b592-f5108171cc0c) {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Sep 03 20:54:22.465672 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:53:18.136665 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Sep 03 20:54:22.466193 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/378.8 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Sep 03 20:54:22.466778 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Filter CapacityFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:54:22.467475 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:54:22.468532 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 1, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:53:18.136665] {{(pid=132453) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 03 20:54:22.469172 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_weight [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Weigher CapacityWeigher returned, weigher value is {max: 397.8, min: 397.8} {{(pid=132453) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 03 20:54:22.469713 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132453) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 03 20:54:22.470330 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132453) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 03 20:54:22.471139 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.94, total_capacity_gb: 19.94, allocated_capacity_gb: 2, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:54:22.470725 {{(pid=132453) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 03 20:54:22.525785 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (110cf4db-46bf-41c2-a959-6fd2b2c92bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:54:22.529867 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-bcf84a86-d2dc-47c5-a66f-0417cc2bca3c tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Flow 'volume_create_scheduler' (2aa928bd-465a-4893-b634-9ebc6a1791ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:54:22.598568 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Flow 'volume_create_scheduler' (4905f99a-df2b-4ed5-ab87-05822cb60e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:54:22.604414 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e0893806-1baf-44c3-b70d-61c3c7bfd303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:54:22.614618 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e0893806-1baf-44c3-b70d-61c3c7bfd303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(3e825662-5770-41ff-ab3b-2e5005a78362),volume_id=3e825662-5770-41ff-ab3b-2e5005a78362,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:54:22.624365 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0ff3b4c9-e22f-49a3-a2f1-f9b418953a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:54:22.651368 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:54:22.685430 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 0, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 3, 20, 52, 52, 663668)} {{(pid=132453) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 03 20:54:22.685824 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Starting with 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 20:54:22.688574 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:54:22.689227 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (3e825662-5770-41ff-ab3b-2e5005a78362) {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Sep 03 20:54:22.689830 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.94, total_capacity_gb: 19.94, allocated_capacity_gb: 2, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:54:22.470725 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Sep 03 20:54:22.691804 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/358.8 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Sep 03 20:54:22.704654 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Filter CapacityFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:54:22.709145 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:54:22.712094 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.94, total_capacity_gb: 19.94, allocated_capacity_gb: 2, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:54:22.470725] {{(pid=132453) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 03 20:54:22.714554 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_weight [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Weigher CapacityWeigher returned, weigher value is {max: 396.8, min: 396.8} {{(pid=132453) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 03 20:54:22.716550 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132453) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 03 20:54:22.717274 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132453) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 03 20:54:22.719235 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 16.94, total_capacity_gb: 19.94, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:54:22.717477 {{(pid=132453) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 03 20:54:22.840618 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0ff3b4c9-e22f-49a3-a2f1-f9b418953a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:54:22.848235 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1a0b1e1d-2828-4591-a8f5-ce55da8f917b tempest-LiveMigrationTest-2111888872 None] Flow 'volume_create_scheduler' (4905f99a-df2b-4ed5-ab87-05822cb60e3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:54:37.974559 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-6dc6e43e-f35a-4d36-abe1-2d5b386df19a None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:54:52.546050 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=27,cinder:UPDATE=6 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:52.818746 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-d2ef7c46-26e4-4bf8-87e7-e36c5e3b6dc5 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:55:27.723087 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:55:27.843837 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Flow 'volume_create_scheduler' (7322b9bb-3d39-4779-a8bd-59e83702cdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:55:27.868039 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ebd68d39-2883-4d99-9f37-35ce2fda6721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:55:27.890290 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ebd68d39-2883-4d99-9f37-35ce2fda6721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f6866eae-8b17-4560-881a-3622ae0208ea),volume_id=f6866eae-8b17-4560-881a-3622ae0208ea,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:55:27.904362 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (723ba1a4-c555-4056-8132-a3113548947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:55:27.924512 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:55:27.964715 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 3, 20, 54, 52, 810807)} {{(pid=132453) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 03 20:55:27.969247 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Starting with 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 20:55:27.970310 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:55:27.970903 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (f6866eae-8b17-4560-881a-3622ae0208ea) {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Sep 03 20:55:27.971535 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:54:52.810807 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Sep 03 20:55:27.972138 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/398.8 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Sep 03 20:55:27.978856 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Filter CapacityFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:55:27.979839 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:55:27.980459 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.94, total_capacity_gb: 19.94, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:54:52.810807] {{(pid=132453) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 03 20:55:27.981154 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_weight [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Weigher CapacityWeigher returned, weigher value is {max: 395.8, min: 395.8} {{(pid=132453) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 03 20:55:27.981734 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132453) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 03 20:55:27.982427 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132453) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 03 20:55:27.983034 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.94, total_capacity_gb: 19.94, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:55:27.982672 {{(pid=132453) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 03 20:55:28.048085 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (723ba1a4-c555-4056-8132-a3113548947b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:55:28.064142 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f3a3b2bb-63ee-48ac-b63d-a953e3e338d6 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Flow 'volume_create_scheduler' (7322b9bb-3d39-4779-a8bd-59e83702cdba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:55:37.983584 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-c7caa65b-43b4-474e-a339-fe2829a1ac3d None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:55:52.646549 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-51389299-cc71-4125-8723-476499dea117 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.5, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 5, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:56:02.466871 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:15.135433 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [req-7421f368-cabd-4c6e-bbd3-c0b84484c367 req-fb4827f2-12bb-4c6f-8ef2-0778e844f81c tempest-LiveMigrationTest-2111888872 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.48, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 4, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:56:16.938927 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-19fa62eb-483c-423f-9f39-90eb463f5722 tempest-LiveMigrationTest-2111888872 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.48, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:56:37.970849 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-a92ed493-9b39-4268-979b-eb2e107c5697 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:56:42.454079 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:56:46.808797 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Flow 'volume_create_scheduler' (78eb3657-7f40-48a6-af4f-a844f45dcc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:56:46.824542 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (adc053a7-19eb-4cca-a728-6a245349df10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:56:46.828986 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (adc053a7-19eb-4cca-a728-6a245349df10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(0adb6e45-9611-454a-af2d-365a145715bc),volume_id=0adb6e45-9611-454a-af2d-365a145715bc,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:56:46.845991 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (699be26f-d3ea-400c-ac75-b344643641c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:56:46.863652 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:56:46.898567 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.93, 'free_capacity_gb': 19.48, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 3, 20, 56, 16, 922823)} {{(pid=132453) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 03 20:56:46.899405 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Starting with 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 20:56:46.899773 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:56:46.900987 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (0adb6e45-9611-454a-af2d-365a145715bc) {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Sep 03 20:56:46.901475 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.48, total_capacity_gb: 19.93, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:56:16.922823 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Sep 03 20:56:46.901830 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/389.6 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Sep 03 20:56:46.904229 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Filter CapacityFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:56:46.904636 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:56:46.905046 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.48, total_capacity_gb: 19.93, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:56:16.922823] {{(pid=132453) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 03 20:56:46.909320 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_weight [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Weigher CapacityWeigher returned, weigher value is {max: 395.6, min: 395.6} {{(pid=132453) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 03 20:56:46.909856 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132453) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 03 20:56:46.910419 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132453) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 03 20:56:46.910818 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.48, total_capacity_gb: 19.93, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:56:46.910448 {{(pid=132453) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 03 20:56:46.974704 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (699be26f-d3ea-400c-ac75-b344643641c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:56:46.985364 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-33c29794-3e1f-49dc-80b7-c1c3eec7878a tempest-ServerRescueNegativeTestJSON-1941320848 None] Flow 'volume_create_scheduler' (78eb3657-7f40-48a6-af4f-a844f45dcc51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:56:52.769361 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-9e7f5168-378c-491a-9025-b08c1d059244 None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.92, 'free_capacity_gb': 19.42, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 4, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:56:54.507794 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [req-aab42a05-e28a-45f2-809f-be69028c67d0 req-30ead7e7-be56-44a4-a479-e3b5d950657f tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.92, 'free_capacity_gb': 19.42, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:56:55.053708 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-afadd432-903b-481b-8a56-aca8e9283505 tempest-LiveAutoBlockMigrationV225Test-1007400564 None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.92, 'free_capacity_gb': 19.46, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 2, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:57:12.472083 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:13.367766 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Flow 'volume_create_scheduler' (ad247910-3bd4-4240-b155-8424dd0e1c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:57:13.378517 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (cf81f91d-105e-459e-80dd-6b5126fc668b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:57:13.391401 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (cf81f91d-105e-459e-80dd-6b5126fc668b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2c1b4a46-e61e-4a8b-ae66-0be67cc1d2d1),volume_id=2c1b4a46-e61e-4a8b-ae66-0be67cc1d2d1,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:57:13.400255 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (19f4724f-74fa-4eb6-b1f9-cad934222db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:57:13.420884 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:57:13.473382 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.92, 'free_capacity_gb': 19.46, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 2, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 3, 20, 56, 55, 48826)} {{(pid=132453) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 03 20:57:13.474513 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Starting with 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 20:57:13.475070 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:57:13.475632 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (2c1b4a46-e61e-4a8b-ae66-0be67cc1d2d1) {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Sep 03 20:57:13.476174 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.46, total_capacity_gb: 19.92, allocated_capacity_gb: 2, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:56:55.048826 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Sep 03 20:57:13.476684 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/389.20000000000005 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Sep 03 20:57:13.477243 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Filter CapacityFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:57:13.477761 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:57:13.478304 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.46, total_capacity_gb: 19.92, allocated_capacity_gb: 2, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:56:55.048826] {{(pid=132453) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 03 20:57:13.478871 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_weight [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Weigher CapacityWeigher returned, weigher value is {max: 396.40000000000003, min: 396.40000000000003} {{(pid=132453) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 03 20:57:13.479360 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132453) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 03 20:57:13.479976 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132453) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 03 20:57:13.480508 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.46, total_capacity_gb: 19.92, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:57:13.480150 {{(pid=132453) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 03 20:57:13.523816 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (19f4724f-74fa-4eb6-b1f9-cad934222db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:57:13.527928 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0200979e-feaa-42f7-9ddf-ad3a11cdc36f tempest-ServerRescueNegativeTestJSON-1941320848 None] Flow 'volume_create_scheduler' (ad247910-3bd4-4240-b155-8424dd0e1c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:57:30.194402 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Flow 'volume_create_scheduler' (017e478d-3699-4d2f-a76b-1cfb8dd6880c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:57:30.222795 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (dd19cb11-4bf2-40ee-b278-66b10b167de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:57:30.236576 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (dd19cb11-4bf2-40ee-b278-66b10b167de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b82bd011-3b1c-4ad2-9e04-33631e236c5c),volume_id=b82bd011-3b1c-4ad2-9e04-33631e236c5c,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:57:30.248423 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b7a69f16-076d-4bc8-8026-5c6e6777ef99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:57:30.267973 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:57:30.303783 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.92, 'free_capacity_gb': 19.46, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 2, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 3, 20, 56, 55, 48826)} {{(pid=132453) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 03 20:57:30.304180 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Starting with 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 20:57:30.304679 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:57:30.304938 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (b82bd011-3b1c-4ad2-9e04-33631e236c5c) {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Sep 03 20:57:30.306231 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.46, total_capacity_gb: 19.92, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:57:13.480150 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Sep 03 20:57:30.306740 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/369.20000000000005 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Sep 03 20:57:30.307589 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Filter CapacityFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:57:30.308218 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:57:30.308827 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.46, total_capacity_gb: 19.92, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:57:13.480150] {{(pid=132453) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 03 20:57:30.309509 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_weight [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Weigher CapacityWeigher returned, weigher value is {max: 395.40000000000003, min: 395.40000000000003} {{(pid=132453) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 03 20:57:30.312245 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132453) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 03 20:57:30.312879 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132453) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 03 20:57:30.313624 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 17.46, total_capacity_gb: 19.92, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:57:30.313088 {{(pid=132453) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 03 20:57:30.376209 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b7a69f16-076d-4bc8-8026-5c6e6777ef99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:57:30.379784 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b404f541-6585-4376-b576-1d457ac4a61f tempest-ServersTestBootFromVolume-544474738 None] Flow 'volume_create_scheduler' (017e478d-3699-4d2f-a76b-1cfb8dd6880c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:57:36.641582 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-b9b7340c-8c7f-4b94-a715-e3c55f5d632f None None] Received volume service update from ncdv-master-1@ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.92, 'free_capacity_gb': 19.46, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Sep 03 20:57:37.967114 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-17c204d9-90b3-49d9-96cd-321954530443 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:57:45.377182 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=35,cinder:UPDATE=8 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:45.430894 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Flow 'volume_create_scheduler' (ded1b68c-f77b-4244-82ab-245502f28d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:57:45.435599 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (160335b5-0c3b-4a4b-9d1d-65767caa4545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:57:45.440103 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (160335b5-0c3b-4a4b-9d1d-65767caa4545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5a0d76b1-45e2-46e6-9baa-ebcef95923d4),volume_id=5a0d76b1-45e2-46e6-9baa-ebcef95923d4,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:57:45.443585 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ac3d8fe1-56eb-42a1-a77b-2d9e169ec7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:57:45.455503 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:57:45.489519 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.92, 'free_capacity_gb': 19.46, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 3, 20, 57, 36, 602292)} {{(pid=132453) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 03 20:57:45.489519 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Starting with 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 20:57:45.489519 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:57:45.489519 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (5a0d76b1-45e2-46e6-9baa-ebcef95923d4) {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Sep 03 20:57:45.490197 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.46, total_capacity_gb: 19.92, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:57:36.602292 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Sep 03 20:57:45.490197 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/389.20000000000005 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Sep 03 20:57:45.490197 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Filter CapacityFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:57:45.490197 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:57:45.494420 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.46, total_capacity_gb: 19.92, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:57:36.602292] {{(pid=132453) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 03 20:57:45.494870 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_weight [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Weigher CapacityWeigher returned, weigher value is {max: 395.40000000000003, min: 395.40000000000003} {{(pid=132453) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 03 20:57:45.495229 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132453) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 03 20:57:45.495706 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132453) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 03 20:57:45.496072 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.46, total_capacity_gb: 19.92, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:57:45.495736 {{(pid=132453) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 03 20:57:45.537641 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ac3d8fe1-56eb-42a1-a77b-2d9e169ec7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:57:45.543640 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Flow 'volume_create_scheduler' (ded1b68c-f77b-4244-82ab-245502f28d1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:58:02.131454 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Flow 'volume_create_scheduler' (4177db6f-46dc-412f-b685-2b8bdfb9773d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:58:02.149031 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (10a9c109-f828-45ab-b8bc-f10b93d70525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:58:02.163931 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (10a9c109-f828-45ab-b8bc-f10b93d70525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5a0d76b1-45e2-46e6-9baa-ebcef95923d4),volume_id=5a0d76b1-45e2-46e6-9baa-ebcef95923d4,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:58:02.176047 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (84f48a13-2114-44fc-82bc-9d10f64d4881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:58:02.178699 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.filter_scheduler [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Error scheduling 5a0d76b1-45e2-46e6-9baa-ebcef95923d4 from last vol-service: ncdv-master-1@ceph#ceph : ['Traceback (most recent call last):\n', ' File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume\n src_volume.create_snap(clone_snap)\n', ' File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper\n', ' File "rbd.pyx", line 3514, in rbd.Image.create_snap\n', "rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-5a0d76b1-45e2-46e6-9baa-ebcef95923d4.clone_snap' from b'volume-2a98a68c-b86c-4af3-b4f2-5063b211791e')\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume\n src_volume.unprotect_snap(clone_snap)\n', ' File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper\n', ' File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap\n', "rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-2a98a68c-b86c-4af3-b4f2-5063b211791e'@b'volume-5a0d76b1-45e2-46e6-9baa-ebcef95923d4.clone_snap')\n"] Sep 03 20:58:02.185140 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Consumed -1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.46, total_capacity_gb: 19.92, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:57:45.495736 {{(pid=132453) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 03 20:58:02.198470 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:58:02.220524 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.92, 'free_capacity_gb': 19.46, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 3, 20, 57, 36, 602292)} {{(pid=132453) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 03 20:58:02.221067 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Starting with 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 20:58:02.221500 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:58:02.223050 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (5a0d76b1-45e2-46e6-9baa-ebcef95923d4) {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Sep 03 20:58:02.223617 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.46, total_capacity_gb: 19.92, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:57:45.495736 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Sep 03 20:58:02.224140 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/389.20000000000005 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Sep 03 20:58:02.224489 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Filter CapacityFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:58:02.224877 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:58:02.225279 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.46, total_capacity_gb: 19.92, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:57:45.495736] {{(pid=132453) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 03 20:58:02.225694 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_weight [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Weigher CapacityWeigher returned, weigher value is {max: 395.40000000000003, min: 395.40000000000003} {{(pid=132453) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 03 20:58:02.233045 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132453) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 03 20:58:02.234004 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132453) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 03 20:58:02.235438 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.46, total_capacity_gb: 19.92, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:58:02.234866 {{(pid=132453) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 03 20:58:02.275101 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (84f48a13-2114-44fc-82bc-9d10f64d4881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:58:02.279508 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Flow 'volume_create_scheduler' (4177db6f-46dc-412f-b685-2b8bdfb9773d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:58:03.038439 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Flow 'volume_create_scheduler' (2df5d532-6283-443d-bb8d-0875c0c5c818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:58:03.043065 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c959af11-20e7-420b-9108-9a04e1a41d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:58:03.052297 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c959af11-20e7-420b-9108-9a04e1a41d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5a0d76b1-45e2-46e6-9baa-ebcef95923d4),volume_id=5a0d76b1-45e2-46e6-9baa-ebcef95923d4,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:58:03.055976 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ec5c19dd-3ba8-4663-9b04-69b510c1e299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:58:03.060917 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.filter_scheduler [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Error scheduling 5a0d76b1-45e2-46e6-9baa-ebcef95923d4 from last vol-service: ncdv-master-1@ceph#ceph : ['Traceback (most recent call last):\n', ' File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume\n src_volume.create_snap(clone_snap)\n', ' File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper\n', ' File "rbd.pyx", line 3514, in rbd.Image.create_snap\n', "rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-5a0d76b1-45e2-46e6-9baa-ebcef95923d4.clone_snap' from b'volume-2a98a68c-b86c-4af3-b4f2-5063b211791e')\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume\n src_volume.unprotect_snap(clone_snap)\n', ' File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper\n', ' File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap\n', "rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-2a98a68c-b86c-4af3-b4f2-5063b211791e'@b'volume-5a0d76b1-45e2-46e6-9baa-ebcef95923d4.clone_snap')\n"] Sep 03 20:58:03.087429 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Consumed -1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.46, total_capacity_gb: 19.92, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:58:02.234866 {{(pid=132453) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 03 20:58:03.111804 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:58:03.153659 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Updating capabilities for ncdv-master-1@ceph#ceph: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.92, 'free_capacity_gb': 19.46, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:35844ec5-7783-41e2-937f-44a580242021:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'allocated_capacity_gb': 3, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2022, 9, 3, 20, 57, 36, 602292)} {{(pid=132453) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Sep 03 20:58:03.154285 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Starting with 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 20:58:03.154425 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:58:03.154758 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Checking if host ncdv-master-1@ceph#ceph can create a 1 GB volume (5a0d76b1-45e2-46e6-9baa-ebcef95923d4) {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:58}} Sep 03 20:58:03.155160 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Checking provisioning for request of 1 GB. Backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.46, total_capacity_gb: 19.92, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:58:02.234866 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:133}} Sep 03 20:58:03.155506 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Space information for volume creation on host ncdv-master-1@ceph#ceph (requested / avail): 1/389.20000000000005 {{(pid=132453) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:166}} Sep 03 20:58:03.155848 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Filter CapacityFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:58:03.156228 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 20:58:03.156607 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Filtered [host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 19.46, total_capacity_gb: 19.92, allocated_capacity_gb: 3, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:58:02.234866] {{(pid=132453) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:371}} Sep 03 20:58:03.167288 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_weight [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Weigher CapacityWeigher returned, weigher value is {max: 395.40000000000003, min: 395.40000000000003} {{(pid=132453) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Sep 03 20:58:03.168288 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Weighed [WeighedHost [host: ncdv-master-1@ceph#ceph, weight: 0.0]] {{(pid=132453) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Sep 03 20:58:03.169213 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.filter_scheduler [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Choosing ncdv-master-1@ceph#ceph {{(pid=132453) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:607}} Sep 03 20:58:03.169750 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Consumed 1 GB from backend: host 'ncdv-master-1@ceph#ceph': free_capacity_gb: 18.46, total_capacity_gb: 19.92, allocated_capacity_gb: 4, max_over_subscription_ratio: 20.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: True, thick_provisioning_support: False, pools: {}, updated at: 2022-09-03 20:58:03.169384 {{(pid=132453) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Sep 03 20:58:03.238780 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ec5c19dd-3ba8-4663-9b04-69b510c1e299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:58:03.248216 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Flow 'volume_create_scheduler' (2df5d532-6283-443d-bb8d-0875c0c5c818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:58:03.924406 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Flow 'volume_create_scheduler' (05ec1297-8b32-4b57-a2ff-47ac670bd02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:58:03.935989 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ecf093ad-88d4-4644-a88c-0bb37af51963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:58:03.944811 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ecf093ad-88d4-4644-a88c-0bb37af51963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5a0d76b1-45e2-46e6-9baa-ebcef95923d4),volume_id=5a0d76b1-45e2-46e6-9baa-ebcef95923d4,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:58:03.948584 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (885352fc-6e35-439e-945c-6ec25abf559a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 20:58:03.950025 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.filter_scheduler [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Error scheduling 5a0d76b1-45e2-46e6-9baa-ebcef95923d4 from last vol-service: ncdv-master-1@ceph#ceph : ['Traceback (most recent call last):\n', ' File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume\n src_volume.create_snap(clone_snap)\n', ' File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper\n', ' File "rbd.pyx", line 3514, in rbd.Image.create_snap\n', "rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-5a0d76b1-45e2-46e6-9baa-ebcef95923d4.clone_snap' from b'volume-2a98a68c-b86c-4af3-b4f2-5063b211791e')\n", '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume\n src_volume.unprotect_snap(clone_snap)\n', ' File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper\n', ' File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap\n', "rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-2a98a68c-b86c-4af3-b4f2-5063b211791e'@b'volume-5a0d76b1-45e2-46e6-9baa-ebcef95923d4.clone_snap')\n"] Sep 03 20:58:03.950523 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Creating message record for request_id = req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b Sep 03 20:58:03.959039 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:58:03.975264 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 5a0d76b1-45e2-46e6-9baa-ebcef95923d4: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 5a0d76b1-45e2-46e6-9baa-ebcef95923d4 Sep 03 20:58:03.976073 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Setting Volume 5a0d76b1-45e2-46e6-9baa-ebcef95923d4 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 5a0d76b1-45e2-46e6-9baa-ebcef95923d4 {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 20:58:04.001039 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (885352fc-6e35-439e-945c-6ec25abf559a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 20:58:04.005593 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ecad3bfb-a7ff-406b-b5df-c55db3063c7b tempest-TaggedBootDevicesTest_v242-1933143257 None] Flow 'volume_create_scheduler' (05ec1297-8b32-4b57-a2ff-47ac670bd02b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 20:58:22.475644 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=42,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:58:37.973104 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-27247cc5-3a55-441b-b646-2ac0ab2bb755 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 20:58:52.506786 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:22.486589 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:59:37.975434 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-52577be8-d2e1-4917-8592-f58596c3c785 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:00:02.492144 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:32.509434 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:00:37.969631 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-92c951ea-0b96-43d8-a3fa-c0906d0a34d1 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:01:12.494858 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:01:17.735249 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Flow 'volume_create_scheduler' (48f7c54b-87a8-4442-9af5-337c11e19b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:01:17.748939 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6cd8c476-7208-4bb2-b8a2-29cc492e9859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:01:17.755376 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6cd8c476-7208-4bb2-b8a2-29cc492e9859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(891c03a1-57c8-46cf-921b-f3a9e05efc1a),volume_id=891c03a1-57c8-46cf-921b-f3a9e05efc1a,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:01:17.758860 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2c123a28-692a-45b6-8c05-97cc12f3799f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:01:17.783007 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:01:17.810681 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:01:17.811230 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.host_manager [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Removing non-active backend: ncdv-master-1@ceph from scheduler cache. Sep 03 21:01:17.811613 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:01:17.811972 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:01:17.812325 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:01:17.812673 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:01:17.813058 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Filtering removed all hosts for the request with volume ID '891c03a1-57c8-46cf-921b-f3a9e05efc1a'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:01:17.813446 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Filtering removed all hosts for the request with volume ID '891c03a1-57c8-46cf-921b-f3a9e05efc1a'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:01:17.815529 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:01:17.815983 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Creating message record for request_id = req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 Sep 03 21:01:17.831281 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:01:17.831742 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Setting Volume 891c03a1-57c8-46cf-921b-f3a9e05efc1a to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:01:17.861938 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2c123a28-692a-45b6-8c05-97cc12f3799f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:01:17.862707 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5dc0d6c0-1be6-4e91-81af-ea589ff7a8e3 tempest-VolumesAdminNegativeTest-2033592886 None] Flow 'volume_create_scheduler' (48f7c54b-87a8-4442-9af5-337c11e19b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:01:37.969440 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-890d30ba-fe13-444d-87da-cdf4c908c53f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:01:38.969928 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] Flow 'volume_create_scheduler' (15407ba5-eced-45d9-90d1-6b01644713f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:01:38.976504 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (efbf43d2-70a4-4c69-8f7a-5f3b5b53d1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:01:38.987483 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (efbf43d2-70a4-4c69-8f7a-5f3b5b53d1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(493d9592-6e71-45d9-af0c-55ef288b22c7),volume_id=493d9592-6e71-45d9-af0c-55ef288b22c7,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:01:38.990948 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3493a8aa-e658-4dbf-b465-97b9189e4e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:01:39.005124 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:01:39.019984 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:01:39.020352 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:01:39.020702 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:01:39.021091 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:01:39.021435 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:01:39.021782 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] Filtering removed all hosts for the request with volume ID '493d9592-6e71-45d9-af0c-55ef288b22c7'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:01:39.022121 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] Filtering removed all hosts for the request with volume ID '493d9592-6e71-45d9-af0c-55ef288b22c7'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:01:39.022600 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:01:39.023022 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] Creating message record for request_id = req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 Sep 03 21:01:39.034005 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:01:39.035508 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] Setting Volume 493d9592-6e71-45d9-af0c-55ef288b22c7 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:01:39.062386 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3493a8aa-e658-4dbf-b465-97b9189e4e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:01:39.072276 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d2a7660e-1eb5-4167-8ff5-8e8470d99011 tempest-VolumesAdminNegativeTest-2033592886 None] Flow 'volume_create_scheduler' (15407ba5-eced-45d9-90d1-6b01644713f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:01:52.498702 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=34,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:32.503763 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:02:37.966522 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-b33337c6-96a2-4fa6-8f4a-719281aced41 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:03:12.511416 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:21.682707 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] Flow 'volume_create_scheduler' (c8873665-0100-4c01-be6a-7afe252d6774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:03:21.704605 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (956aa3a5-99e6-430a-8c3f-c60b079758b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:03:21.712333 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (956aa3a5-99e6-430a-8c3f-c60b079758b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c5816d23-6cb2-4482-be78-18bf7e1f14cf),volume_id=c5816d23-6cb2-4482-be78-18bf7e1f14cf,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:03:21.723156 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9df1b802-d416-4008-9bf6-bacf72437f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:03:21.739946 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:03:21.755679 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:03:21.756058 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:03:21.756414 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:03:21.756760 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:03:21.757317 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:03:21.757835 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] Filtering removed all hosts for the request with volume ID 'c5816d23-6cb2-4482-be78-18bf7e1f14cf'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:03:21.758368 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] Filtering removed all hosts for the request with volume ID 'c5816d23-6cb2-4482-be78-18bf7e1f14cf'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:03:21.759117 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:03:21.759801 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] Creating message record for request_id = req-47bec73e-a487-4018-b06c-32d79005fe29 Sep 03 21:03:21.768466 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:03:21.769587 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] Setting Volume c5816d23-6cb2-4482-be78-18bf7e1f14cf to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:03:21.786889 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9df1b802-d416-4008-9bf6-bacf72437f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:03:21.791664 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-47bec73e-a487-4018-b06c-32d79005fe29 tempest-DeleteServersTestJSON-1106439313 None] Flow 'volume_create_scheduler' (c8873665-0100-4c01-be6a-7afe252d6774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:03:37.972503 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-9e541883-5e4b-444e-b744-a1838016a5ac None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:03:39.074384 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] Flow 'volume_create_scheduler' (00908f4c-517e-446d-ad2b-f1b594a50208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:03:39.091852 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (742d09d3-f0fc-4335-ac05-5425b58d1a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:03:39.110237 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (742d09d3-f0fc-4335-ac05-5425b58d1a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(de11a97b-eba9-4f1d-b3e4-305db75bd791),volume_id=de11a97b-eba9-4f1d-b3e4-305db75bd791,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:03:39.114548 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1d7acaf3-60bc-4e0b-b03a-93f79d984e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:03:39.123568 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:03:39.145859 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:03:39.146869 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:03:39.147469 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:03:39.147977 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:03:39.148610 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:03:39.149146 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] Filtering removed all hosts for the request with volume ID 'de11a97b-eba9-4f1d-b3e4-305db75bd791'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:03:39.149705 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] Filtering removed all hosts for the request with volume ID 'de11a97b-eba9-4f1d-b3e4-305db75bd791'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:03:39.151179 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:03:39.151968 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] Creating message record for request_id = req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f Sep 03 21:03:39.160217 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:03:39.160605 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] Setting Volume de11a97b-eba9-4f1d-b3e4-305db75bd791 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:03:39.192668 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1d7acaf3-60bc-4e0b-b03a-93f79d984e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:03:39.199574 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5f81dfe9-9cc6-4c5d-8958-10515943cb4f tempest-TaggedBootDevicesTest-1781373707 None] Flow 'volume_create_scheduler' (00908f4c-517e-446d-ad2b-f1b594a50208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:03:42.523564 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=33,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=2 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:03:53.298081 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] Flow 'volume_create_scheduler' (122e498a-95ac-4cdd-a435-109f2f0cb83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:03:53.303398 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (36216351-d7a7-43a7-9e6f-a7f70da2afe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:03:53.308478 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (36216351-d7a7-43a7-9e6f-a7f70da2afe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(1f3a4913-45ba-4940-8f13-5ab1580e95e0),volume_id=1f3a4913-45ba-4940-8f13-5ab1580e95e0,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:03:53.313031 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0567b489-de1e-404e-81fe-f7b9a1734813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:03:53.321585 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:03:53.359804 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:03:53.360695 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:03:53.361270 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:03:53.362280 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:03:53.362897 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:03:53.363604 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] Filtering removed all hosts for the request with volume ID '1f3a4913-45ba-4940-8f13-5ab1580e95e0'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:03:53.364620 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] Filtering removed all hosts for the request with volume ID '1f3a4913-45ba-4940-8f13-5ab1580e95e0'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:03:53.365623 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:03:53.366258 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] Creating message record for request_id = req-aea546b9-4cf4-4c46-851d-7f45002a824a Sep 03 21:03:53.376340 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:03:53.376723 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] Setting Volume 1f3a4913-45ba-4940-8f13-5ab1580e95e0 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:03:53.420576 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0567b489-de1e-404e-81fe-f7b9a1734813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:03:53.420576 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-aea546b9-4cf4-4c46-851d-7f45002a824a tempest-AttachSCSIVolumeTestJSON-1275961717 None] Flow 'volume_create_scheduler' (122e498a-95ac-4cdd-a435-109f2f0cb83a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:04:09.737703 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] Flow 'volume_create_scheduler' (b4a70935-ee87-458e-9654-1950ae01f596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:04:09.754592 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (56d4cf96-61ec-4301-ab85-85c88c3ca613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:04:09.769951 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (56d4cf96-61ec-4301-ab85-85c88c3ca613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(adb6dcab-1c20-4d3c-a997-550db6ef087a),volume_id=adb6dcab-1c20-4d3c-a997-550db6ef087a,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:04:09.773754 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3cca6003-e0a6-4fb1-8644-33fe73bb2c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:04:09.793602 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:04:09.831470 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:04:09.833368 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:04:09.833972 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:04:09.836678 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:04:09.837660 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:04:09.838910 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] Filtering removed all hosts for the request with volume ID 'adb6dcab-1c20-4d3c-a997-550db6ef087a'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:04:09.839833 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] Filtering removed all hosts for the request with volume ID 'adb6dcab-1c20-4d3c-a997-550db6ef087a'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:04:09.840552 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:04:09.841265 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] Creating message record for request_id = req-88c97ac9-d605-44b0-996b-71624b32d0d9 Sep 03 21:04:09.858394 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:04:09.859004 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] Setting Volume adb6dcab-1c20-4d3c-a997-550db6ef087a to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:04:09.888136 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3cca6003-e0a6-4fb1-8644-33fe73bb2c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:04:09.897829 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-88c97ac9-d605-44b0-996b-71624b32d0d9 tempest-AttachVolumeTestJSON-653920500 None] Flow 'volume_create_scheduler' (b4a70935-ee87-458e-9654-1950ae01f596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:04:22.540486 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=8,cinder:SELECT=32,cinder:INSERT=2,cinder:DELETE=2 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:04:37.975434 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-a2dca92d-1dcb-42e9-ae43-986367e63c9c None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:05:02.541500 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:07.337157 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-e214fee1-0b24-447c-b35d-3c831653b7f9 tempest-BackendsCapabilitiesAdminTestsJSON-549736641 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:05:07.396576 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-8fbbc916-6e61-4376-aa0e-d509bd978bf6 tempest-BackendsCapabilitiesAdminTestsJSON-549736641 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:05:19.834853 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-071af0cb-1d0e-46d4-a006-1f430f5f1e56 tempest-GroupsV320Test-1050598731 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:05:19.859876 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-071af0cb-1d0e-46d4-a006-1f430f5f1e56 tempest-GroupsV320Test-1050598731 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:05:19.860638 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.manager [None req-071af0cb-1d0e-46d4-a006-1f430f5f1e56 tempest-GroupsV320Test-1050598731 None] Could not find a backend for group 09884ca2-0226-4354-b200-3f07f28747a1.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:05:37.976588 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ad40653a-4672-4835-8abc-96dae6027617 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:05:41.862752 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=21,cinder:UPDATE=5 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:41.905786 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] Flow 'volume_create_scheduler' (d2d3d3a5-1820-4a15-9ca3-fda04e305dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:05:41.910396 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b350d5ed-9fc1-4805-96d4-72ae9b1c6382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:05:41.914638 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b350d5ed-9fc1-4805-96d4-72ae9b1c6382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8e2521d6-fc7d-4aad-a836-cb26ab3049ba),volume_id=8e2521d6-fc7d-4aad-a836-cb26ab3049ba,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:05:41.918397 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4fbd3674-ccfa-434f-a7d8-5633c26fe76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:05:41.929211 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:05:41.958348 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:05:41.958897 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:05:41.959761 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:41.961272 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:41.961801 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:41.963261 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] Filtering removed all hosts for the request with volume ID '8e2521d6-fc7d-4aad-a836-cb26ab3049ba'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:05:41.963851 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] Filtering removed all hosts for the request with volume ID '8e2521d6-fc7d-4aad-a836-cb26ab3049ba'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:05:41.964407 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:05:41.965070 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] Creating message record for request_id = req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f Sep 03 21:05:41.989195 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:05:41.989777 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] Setting Volume 8e2521d6-fc7d-4aad-a836-cb26ab3049ba to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:05:42.002288 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4fbd3674-ccfa-434f-a7d8-5633c26fe76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:05:42.007315 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e802fc44-21d9-4c7e-b81f-041f86ce3c0f tempest-VolumesActionsTest-1411961036 None] Flow 'volume_create_scheduler' (d2d3d3a5-1820-4a15-9ca3-fda04e305dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:05:48.014058 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] Flow 'volume_create_scheduler' (9c65b2c1-0641-490f-b042-a2c371ee2fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:05:48.021282 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7a08924d-42d9-4a1c-b3c0-3635a1c59fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:05:48.026458 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7a08924d-42d9-4a1c-b3c0-3635a1c59fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(539cdc5f-41e5-48dc-8a42-931e0fec1e2e),volume_id=539cdc5f-41e5-48dc-8a42-931e0fec1e2e,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:05:48.031988 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (717a3640-9397-4884-820b-66b91f7d0c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:05:48.041182 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:05:48.057527 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:05:48.058378 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:05:48.058923 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:48.059417 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:48.059912 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:48.060511 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] Filtering removed all hosts for the request with volume ID '539cdc5f-41e5-48dc-8a42-931e0fec1e2e'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:05:48.061079 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] Filtering removed all hosts for the request with volume ID '539cdc5f-41e5-48dc-8a42-931e0fec1e2e'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:05:48.061891 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:05:48.062513 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] Creating message record for request_id = req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 Sep 03 21:05:48.070996 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:05:48.071620 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] Setting Volume 539cdc5f-41e5-48dc-8a42-931e0fec1e2e to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:05:48.092134 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (717a3640-9397-4884-820b-66b91f7d0c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:05:48.101142 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4b4f4ea6-1478-448a-ad3a-daa18fbbce39 tempest-VolumesActionsTest-1411961036 None] Flow 'volume_create_scheduler' (9c65b2c1-0641-490f-b042-a2c371ee2fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:05:49.663057 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] Flow 'volume_create_scheduler' (52ae9665-296a-4342-92b3-d76d202e71a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:05:49.676878 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b3569964-9ecc-4376-8c3a-31a9bb1d0b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:05:49.688804 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b3569964-9ecc-4376-8c3a-31a9bb1d0b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(834b8a1b-c384-4bc2-a1d2-7f0242dfd98e),volume_id=834b8a1b-c384-4bc2-a1d2-7f0242dfd98e,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:05:49.700854 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (66a0bc29-5c6e-4f19-9873-48866e37fcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:05:49.728506 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:05:49.746009 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:05:49.746649 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:05:49.747160 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:49.748226 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:49.749398 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:49.749777 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] Filtering removed all hosts for the request with volume ID '834b8a1b-c384-4bc2-a1d2-7f0242dfd98e'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:05:49.750506 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] Filtering removed all hosts for the request with volume ID '834b8a1b-c384-4bc2-a1d2-7f0242dfd98e'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:05:49.751368 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:05:49.752037 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] Creating message record for request_id = req-79512549-300d-479e-be90-0da65cbdcd6e Sep 03 21:05:49.761074 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:05:49.761345 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] Setting Volume 834b8a1b-c384-4bc2-a1d2-7f0242dfd98e to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:05:49.776568 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (66a0bc29-5c6e-4f19-9873-48866e37fcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:05:49.793052 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-79512549-300d-479e-be90-0da65cbdcd6e tempest-VolumesActionsTest-1411961036 None] Flow 'volume_create_scheduler' (52ae9665-296a-4342-92b3-d76d202e71a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:05:51.262151 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] Flow 'volume_create_scheduler' (bdb087db-a033-495d-8f39-1e5a448060ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:05:51.266960 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (852597bf-d976-4454-a2b4-23b9887a8b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:05:51.280443 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (852597bf-d976-4454-a2b4-23b9887a8b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bcc9f943-6b34-42bc-9914-937fcf3038cd),volume_id=bcc9f943-6b34-42bc-9914-937fcf3038cd,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:05:51.290140 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (df0cb063-eee5-4e59-9963-f0891e93e74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:05:51.314770 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:05:51.335645 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:05:51.336764 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:05:51.337559 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:51.338514 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:51.339258 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:51.340038 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] Filtering removed all hosts for the request with volume ID 'bcc9f943-6b34-42bc-9914-937fcf3038cd'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:05:51.340717 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] Filtering removed all hosts for the request with volume ID 'bcc9f943-6b34-42bc-9914-937fcf3038cd'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:05:51.341601 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:05:51.342225 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] Creating message record for request_id = req-f93614ba-a0dc-4c73-8b98-f78058cec09e Sep 03 21:05:51.352712 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:05:51.353509 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] Setting Volume bcc9f943-6b34-42bc-9914-937fcf3038cd to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:05:51.374839 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (df0cb063-eee5-4e59-9963-f0891e93e74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:05:51.383824 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f93614ba-a0dc-4c73-8b98-f78058cec09e tempest-VolumesActionsTest-1411961036 None] Flow 'volume_create_scheduler' (bdb087db-a033-495d-8f39-1e5a448060ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:05:53.051230 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] Flow 'volume_create_scheduler' (68617462-65c7-4567-be65-e229687e8443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:05:53.057557 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3326bf6e-c8e4-4fe4-8354-19a39cd86a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:05:53.066955 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3326bf6e-c8e4-4fe4-8354-19a39cd86a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(27478688-b78e-4569-a64e-675f57e03db9),volume_id=27478688-b78e-4569-a64e-675f57e03db9,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:05:53.073221 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b763fd3f-cd92-49d9-92c6-d591be88c0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:05:53.103127 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:05:53.156113 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:05:53.156812 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:05:53.157398 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:53.157955 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:53.158500 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:53.159059 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] Filtering removed all hosts for the request with volume ID '27478688-b78e-4569-a64e-675f57e03db9'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:05:53.159641 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] Filtering removed all hosts for the request with volume ID '27478688-b78e-4569-a64e-675f57e03db9'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:05:53.160322 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:05:53.161044 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] Creating message record for request_id = req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf Sep 03 21:05:53.168518 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:05:53.169240 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] Setting Volume 27478688-b78e-4569-a64e-675f57e03db9 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:05:53.180753 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b763fd3f-cd92-49d9-92c6-d591be88c0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:05:53.184397 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0c0ff391-bb91-4842-ad2a-c0b49e5c4bcf tempest-VolumesActionsTest-1411961036 None] Flow 'volume_create_scheduler' (68617462-65c7-4567-be65-e229687e8443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:05:54.731286 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] Flow 'volume_create_scheduler' (6b039e7e-3122-4220-9a33-edcb4dc05038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:05:54.742690 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2d667ce8-e20d-4f6a-aec5-c2e13099d76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:05:54.755200 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2d667ce8-e20d-4f6a-aec5-c2e13099d76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(0a8e3a78-d482-45a4-a190-b8b81fbe82d1),volume_id=0a8e3a78-d482-45a4-a190-b8b81fbe82d1,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:05:54.764244 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (920c67fc-cc69-4ac0-83c5-f2e06236699f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:05:54.783448 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:05:54.832831 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:05:54.833228 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:05:54.843113 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:54.844404 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:54.844999 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:05:54.847776 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] Filtering removed all hosts for the request with volume ID '0a8e3a78-d482-45a4-a190-b8b81fbe82d1'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:05:54.848668 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] Filtering removed all hosts for the request with volume ID '0a8e3a78-d482-45a4-a190-b8b81fbe82d1'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:05:54.849353 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:05:54.849947 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] Creating message record for request_id = req-b7ab779a-af7c-422c-8194-e7c9cca0123b Sep 03 21:05:54.867097 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:05:54.867808 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] Setting Volume 0a8e3a78-d482-45a4-a190-b8b81fbe82d1 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:05:54.887271 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (920c67fc-cc69-4ac0-83c5-f2e06236699f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:05:54.896648 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b7ab779a-af7c-422c-8194-e7c9cca0123b tempest-VolumesActionsTest-1411961036 None] Flow 'volume_create_scheduler' (6b039e7e-3122-4220-9a33-edcb4dc05038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:05:59.849900 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=74,cinder:UPDATE=14,cinder:INSERT=6,cinder:DELETE=6 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:05:59.913543 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] Flow 'volume_create_scheduler' (f716f06d-b919-49c1-88fc-5dc6e8b05d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:05:59.925003 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a4d04762-2817-40f5-a8a7-e9883572dde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:05:59.939103 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a4d04762-2817-40f5-a8a7-e9883572dde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(1046a3ac-2bd0-4813-a328-d56f72f624b2),volume_id=1046a3ac-2bd0-4813-a328-d56f72f624b2,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:05:59.947741 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (669ab6ba-c52f-4c09-b5d0-9bf79edff1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:05:59.982404 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:05:59.998902 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:05:59.999610 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:06:00.000200 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:06:00.000759 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:06:00.001833 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:06:00.002396 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] Filtering removed all hosts for the request with volume ID '1046a3ac-2bd0-4813-a328-d56f72f624b2'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:06:00.002952 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] Filtering removed all hosts for the request with volume ID '1046a3ac-2bd0-4813-a328-d56f72f624b2'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:06:00.003675 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:06:00.004434 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] Creating message record for request_id = req-f9b44079-6441-44e5-bda1-793618a4f8ea Sep 03 21:06:00.014600 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:06:00.015577 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] Setting Volume 1046a3ac-2bd0-4813-a328-d56f72f624b2 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:06:00.041722 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (669ab6ba-c52f-4c09-b5d0-9bf79edff1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:06:00.045870 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f9b44079-6441-44e5-bda1-793618a4f8ea tempest-AttachVolumeTestJSON-653920500 None] Flow 'volume_create_scheduler' (f716f06d-b919-49c1-88fc-5dc6e8b05d2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:06:10.369191 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] Flow 'volume_create_scheduler' (f034ecd5-2e8c-4d01-803a-69ab759492fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:06:10.376486 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (07a4f38b-e4f3-457a-a81d-0682d3af0efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:06:10.383598 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (07a4f38b-e4f3-457a-a81d-0682d3af0efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4455d673-f48a-4966-b764-591dc5f5cca2),volume_id=4455d673-f48a-4966-b764-591dc5f5cca2,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:06:10.388144 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7c0923db-1ecb-4d63-82d3-92d5460ae4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:06:10.399677 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:06:10.418229 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:06:10.418768 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:06:10.419288 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:06:10.419928 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:06:10.421088 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:06:10.422118 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] Filtering removed all hosts for the request with volume ID '4455d673-f48a-4966-b764-591dc5f5cca2'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:06:10.422599 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] Filtering removed all hosts for the request with volume ID '4455d673-f48a-4966-b764-591dc5f5cca2'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:06:10.423357 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:06:10.424410 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] Creating message record for request_id = req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca Sep 03 21:06:10.441490 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:06:10.445538 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] Setting Volume 4455d673-f48a-4966-b764-591dc5f5cca2 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:06:10.467220 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7c0923db-1ecb-4d63-82d3-92d5460ae4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:06:10.470767 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d82f91e8-0223-46c8-afd0-c2fc25cca3ca tempest-VolumesBackupsAdminTest-1439935434 None] Flow 'volume_create_scheduler' (f034ecd5-2e8c-4d01-803a-69ab759492fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:06:12.112724 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] Flow 'volume_create_scheduler' (baff7884-34be-4528-b221-eecb60ebc90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:06:12.138641 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (aa7e39bb-e4b5-47cd-a3e7-746d54384c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:06:12.150398 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (aa7e39bb-e4b5-47cd-a3e7-746d54384c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8effc4d8-6e1a-4fa7-bbea-9ff5cf7ea498),volume_id=8effc4d8-6e1a-4fa7-bbea-9ff5cf7ea498,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:06:12.165532 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (30c1dbc9-eed1-40cb-b763-e6764218d96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:06:12.196582 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:06:12.235370 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:06:12.235996 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:06:12.236496 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:06:12.237018 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:06:12.237505 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:06:12.238114 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] Filtering removed all hosts for the request with volume ID '8effc4d8-6e1a-4fa7-bbea-9ff5cf7ea498'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:06:12.238603 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] Filtering removed all hosts for the request with volume ID '8effc4d8-6e1a-4fa7-bbea-9ff5cf7ea498'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:06:12.239350 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:06:12.239930 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] Creating message record for request_id = req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd Sep 03 21:06:12.248602 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:06:12.249525 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] Setting Volume 8effc4d8-6e1a-4fa7-bbea-9ff5cf7ea498 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:06:12.266378 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (30c1dbc9-eed1-40cb-b763-e6764218d96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:06:12.270425 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d6b6f513-2dc0-41ef-bb1c-5d80e57621bd tempest-VolumesBackupsAdminTest-1439935434 None] Flow 'volume_create_scheduler' (baff7884-34be-4528-b221-eecb60ebc90b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:06:32.562946 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=9,cinder:SELECT=40,cinder:INSERT=3,cinder:DELETE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:06:37.970373 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-a30f172c-a9f2-4c62-8594-386d5e6aa940 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:07:02.582487 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:32.596284 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:07:37.980178 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-cbba32f6-83d1-4279-827a-fc34c66b7bbf None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:07:59.040724 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] Flow 'volume_create_scheduler' (efe0a924-7754-4221-b87c-095903b2ed0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:07:59.046431 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5116ff7c-0052-460a-93cd-8d32674ec515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:07:59.050789 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5116ff7c-0052-460a-93cd-8d32674ec515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(85b57844-6804-4dc6-b968-cde4b6a134cb),volume_id=85b57844-6804-4dc6-b968-cde4b6a134cb,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:07:59.055182 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1dfe6923-929c-40cb-8358-788ca4b2d67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:07:59.065965 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:07:59.093837 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:07:59.094318 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:07:59.094792 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:07:59.095234 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:07:59.095662 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:07:59.096236 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] Filtering removed all hosts for the request with volume ID '85b57844-6804-4dc6-b968-cde4b6a134cb'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:07:59.096785 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] Filtering removed all hosts for the request with volume ID '85b57844-6804-4dc6-b968-cde4b6a134cb'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:07:59.098295 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:07:59.098952 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] Creating message record for request_id = req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 Sep 03 21:07:59.107767 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:07:59.108540 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] Setting Volume 85b57844-6804-4dc6-b968-cde4b6a134cb to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:07:59.127811 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1dfe6923-929c-40cb-8358-788ca4b2d67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:07:59.149358 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-285e27d9-7e9d-4231-bfc4-6dfa6ca9d4f6 tempest-VolumesTestJSON-1164227153 None] Flow 'volume_create_scheduler' (efe0a924-7754-4221-b87c-095903b2ed0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:08:12.580510 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=6,cinder:SELECT=21,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:08:37.969285 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-991508a5-16ff-41cd-be26-657f33811c81 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:08:52.618131 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:09:32.586108 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:09:37.968867 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-055c203d-2edf-4ef6-b4fc-e492ad119c49 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:09:41.882746 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] Flow 'volume_create_scheduler' (42ab2d9d-aa7f-4468-ac13-19699b9ce8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:09:41.887640 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a17f64ef-4f4e-4d65-8276-d19de0d34cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:09:41.891428 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a17f64ef-4f4e-4d65-8276-d19de0d34cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(abe6d180-7b38-4397-8094-5a00703507ad),volume_id=abe6d180-7b38-4397-8094-5a00703507ad,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:09:41.895985 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (250f544d-e436-49a4-a4a6-45dd424964af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:09:41.905298 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:09:41.920640 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:09:41.921269 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:09:41.921770 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:09:41.922293 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:09:41.922784 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:09:41.923280 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] Filtering removed all hosts for the request with volume ID 'abe6d180-7b38-4397-8094-5a00703507ad'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:09:41.923813 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] Filtering removed all hosts for the request with volume ID 'abe6d180-7b38-4397-8094-5a00703507ad'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:09:41.924529 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:09:41.925293 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] Creating message record for request_id = req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f Sep 03 21:09:41.942178 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:09:41.942791 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] Setting Volume abe6d180-7b38-4397-8094-5a00703507ad to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:09:41.956832 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (250f544d-e436-49a4-a4a6-45dd424964af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:09:41.963520 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-deb5f057-6e61-4dbd-a7ed-6c3e8aabbd6f tempest-VolumeQuotasNegativeTestJSON-1399851970 None] Flow 'volume_create_scheduler' (42ab2d9d-aa7f-4468-ac13-19699b9ce8b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:09:42.702921 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] Flow 'volume_create_scheduler' (dcc05d67-f952-428d-ad10-826ef5852888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:09:42.708832 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2f584a5f-c3b8-481a-8d6b-5fe5b35f7c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:09:42.714741 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2f584a5f-c3b8-481a-8d6b-5fe5b35f7c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(04fe0001-534c-4ae7-85e0-554a68510c25),volume_id=04fe0001-534c-4ae7-85e0-554a68510c25,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:09:42.719339 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c71c1ca5-e1f4-47fa-9275-114121fe90d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:09:42.730108 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:09:42.744969 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:09:42.745336 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:09:42.745704 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:09:42.746054 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:09:42.746398 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:09:42.746747 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] Filtering removed all hosts for the request with volume ID '04fe0001-534c-4ae7-85e0-554a68510c25'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:09:42.747085 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] Filtering removed all hosts for the request with volume ID '04fe0001-534c-4ae7-85e0-554a68510c25'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:09:42.747594 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:09:42.748016 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] Creating message record for request_id = req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 Sep 03 21:09:42.755080 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:09:42.755597 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] Setting Volume 04fe0001-534c-4ae7-85e0-554a68510c25 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:09:42.766939 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c71c1ca5-e1f4-47fa-9275-114121fe90d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:09:42.770437 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-3c9d14a4-3b9a-454f-9ef3-cfae92dfd512 tempest-AttachVolumeNegativeTest-66898911 None] Flow 'volume_create_scheduler' (dcc05d67-f952-428d-ad10-826ef5852888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:09:56.065184 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] Flow 'volume_create_scheduler' (d1b28166-e5a1-4773-993e-e4b7f44a0c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:09:56.070959 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (988933f0-4ceb-474e-b3a9-5ec85da192db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:09:56.077083 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (988933f0-4ceb-474e-b3a9-5ec85da192db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9e3b1436-b8a9-4de8-b195-f338e8e7dcaf),volume_id=9e3b1436-b8a9-4de8-b195-f338e8e7dcaf,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:09:56.081901 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (216580c8-ebcd-43a9-b4da-e5cfec4a3ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:09:56.092528 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:09:56.127443 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:09:56.138642 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:09:56.139170 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:09:56.139628 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:09:56.140081 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:09:56.140675 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] Filtering removed all hosts for the request with volume ID '9e3b1436-b8a9-4de8-b195-f338e8e7dcaf'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:09:56.141084 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] Filtering removed all hosts for the request with volume ID '9e3b1436-b8a9-4de8-b195-f338e8e7dcaf'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:09:56.141678 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:09:56.142268 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] Creating message record for request_id = req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 Sep 03 21:09:56.150879 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:09:56.151437 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] Setting Volume 9e3b1436-b8a9-4de8-b195-f338e8e7dcaf to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:09:56.167137 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (216580c8-ebcd-43a9-b4da-e5cfec4a3ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:09:56.171225 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-70b08c55-172b-43ad-99aa-f6ab51f5fa62 tempest-VolumesCloneNegativeTest-1805551613 None] Flow 'volume_create_scheduler' (d1b28166-e5a1-4773-993e-e4b7f44a0c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:07.516514 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=45,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:07.558554 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] Flow 'volume_create_scheduler' (a68a2352-8a05-4dd6-b1ef-9578affb5263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:07.562616 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e3e0bb21-a747-40bb-9002-9b0750b51020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:07.567448 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e3e0bb21-a747-40bb-9002-9b0750b51020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(18eb258c-6e01-4dfe-9d00-fc31e54230b6),volume_id=18eb258c-6e01-4dfe-9d00-fc31e54230b6,volume_properties=VolumeProperties,volume_type=VolumeType(3c9f4be1-1fd1-4629-b9c1-ce90d83434ce))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:07.570768 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (907f6ffb-a7ee-48ff-9322-a4f9dbca0c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:07.581800 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:10:07.595224 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:10:07.595580 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:10:07.595937 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:07.596280 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:07.596621 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:07.596985 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] Filtering removed all hosts for the request with volume ID '18eb258c-6e01-4dfe-9d00-fc31e54230b6'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:10:07.597350 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] Filtering removed all hosts for the request with volume ID '18eb258c-6e01-4dfe-9d00-fc31e54230b6'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:10:07.597821 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] No weighed backend found for volume with properties: {'id': '3c9f4be1-1fd1-4629-b9c1-ce90d83434ce', 'name': 'tempest-UserMessagesTest-volume-type-1076691411', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'storage_protocol': 'tempest-storage_protocol-1943805919', 'vendor_name': 'tempest-vendor_name-1228404417'}, 'qos_specs_id': None, 'created_at': '2022-09-03T21:10:07.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:10:07.598240 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] Creating message record for request_id = req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec Sep 03 21:10:07.605124 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:10:07.605501 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] Setting Volume 18eb258c-6e01-4dfe-9d00-fc31e54230b6 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:10:07.615892 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (907f6ffb-a7ee-48ff-9322-a4f9dbca0c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:07.619041 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-6f2e4079-7ee9-4ffb-92c2-dcaf3a60b2ec tempest-UserMessagesTest-1105653560 None] Flow 'volume_create_scheduler' (a68a2352-8a05-4dd6-b1ef-9578affb5263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:09.041254 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] Flow 'volume_create_scheduler' (9070ae3d-56fb-4271-aafc-356160936447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:09.046349 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (53586956-3e38-46b0-89be-5a7ad9babf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:09.050845 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (53586956-3e38-46b0-89be-5a7ad9babf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(62d3d635-5d94-4e3d-b6f7-62dc942b8f00),volume_id=62d3d635-5d94-4e3d-b6f7-62dc942b8f00,volume_properties=VolumeProperties,volume_type=VolumeType(270e0a29-73a2-41e4-9b2c-632d326af4be))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:09.054364 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (53af2ab8-d1e0-413e-bfb4-4bb012305408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:09.078037 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:10:09.096770 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:10:09.097299 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:10:09.097749 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:09.098193 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:09.098631 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:09.099072 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] Filtering removed all hosts for the request with volume ID '62d3d635-5d94-4e3d-b6f7-62dc942b8f00'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:10:09.099519 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] Filtering removed all hosts for the request with volume ID '62d3d635-5d94-4e3d-b6f7-62dc942b8f00'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:10:09.100208 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] No weighed backend found for volume with properties: {'id': '270e0a29-73a2-41e4-9b2c-632d326af4be', 'name': 'tempest-UserMessagesTest-volume-type-493116142', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'storage_protocol': 'tempest-storage_protocol-1488783428', 'vendor_name': 'tempest-vendor_name-657195539'}, 'qos_specs_id': None, 'created_at': '2022-09-03T21:10:09.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:10:09.101049 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] Creating message record for request_id = req-009485f8-fc89-4e92-b709-08c32edd116e Sep 03 21:10:09.109373 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:10:09.110011 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] Setting Volume 62d3d635-5d94-4e3d-b6f7-62dc942b8f00 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:10:09.122382 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (53af2ab8-d1e0-413e-bfb4-4bb012305408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:09.128391 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-009485f8-fc89-4e92-b709-08c32edd116e tempest-UserMessagesTest-1105653560 None] Flow 'volume_create_scheduler' (9070ae3d-56fb-4271-aafc-356160936447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:14.917727 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] Flow 'volume_create_scheduler' (71066f55-477f-42a8-ba83-47267f0afdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:14.924820 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (062739c1-4509-440f-a954-09265f9c36a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:14.929268 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (062739c1-4509-440f-a954-09265f9c36a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(3a85f920-a707-4332-81ed-187a49844389),volume_id=3a85f920-a707-4332-81ed-187a49844389,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:14.933538 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a6149755-e925-4dea-9fc1-803e89f5a8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:14.942124 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:10:14.958280 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:10:14.958644 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:10:14.958997 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:14.959402 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:14.959750 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:14.960105 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] Filtering removed all hosts for the request with volume ID '3a85f920-a707-4332-81ed-187a49844389'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:10:14.960442 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] Filtering removed all hosts for the request with volume ID '3a85f920-a707-4332-81ed-187a49844389'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:10:14.961192 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:10:14.962079 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] Creating message record for request_id = req-8be1c56f-7205-4e48-a32f-c0d53611eb89 Sep 03 21:10:14.969457 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:10:14.970563 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] Setting Volume 3a85f920-a707-4332-81ed-187a49844389 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:10:14.982312 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a6149755-e925-4dea-9fc1-803e89f5a8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:14.986824 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-8be1c56f-7205-4e48-a32f-c0d53611eb89 tempest-VolumesServicesTestJSON-573366610 None] Flow 'volume_create_scheduler' (71066f55-477f-42a8-ba83-47267f0afdc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:19.478293 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] Flow 'volume_create_scheduler' (cfcbcc6e-ebf7-45ad-96e8-7de443709875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:19.482383 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ce65b145-dd43-43b9-b7fd-789df7309aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:19.487087 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ce65b145-dd43-43b9-b7fd-789df7309aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8ca5dc2d-0dbf-44ec-aab4-22217ba255b0),volume_id=8ca5dc2d-0dbf-44ec-aab4-22217ba255b0,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:19.490827 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a887b0c3-19fb-403f-bb92-425d97376a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:19.503199 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:10:19.517098 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:10:19.517465 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:10:19.517818 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:19.518335 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:19.518893 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:19.519439 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] Filtering removed all hosts for the request with volume ID '8ca5dc2d-0dbf-44ec-aab4-22217ba255b0'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:10:19.519984 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] Filtering removed all hosts for the request with volume ID '8ca5dc2d-0dbf-44ec-aab4-22217ba255b0'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:10:19.520624 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:10:19.521284 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] Creating message record for request_id = req-9cb038c2-9e66-4c8f-bedb-0817358b2790 Sep 03 21:10:19.527216 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:10:19.527777 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] Setting Volume 8ca5dc2d-0dbf-44ec-aab4-22217ba255b0 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:10:19.538276 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a887b0c3-19fb-403f-bb92-425d97376a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:19.541562 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-9cb038c2-9e66-4c8f-bedb-0817358b2790 tempest-VolumesListAdminTestJSON-1146563263 None] Flow 'volume_create_scheduler' (cfcbcc6e-ebf7-45ad-96e8-7de443709875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:23.817149 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] Flow 'volume_create_scheduler' (c212ce2a-3d74-423e-865c-f64f9f555116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:23.837499 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b6d9f7f6-7036-4853-b554-a81a3cb24968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:23.850535 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b6d9f7f6-7036-4853-b554-a81a3cb24968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(97f1f39b-11fd-4833-a9b0-ad689258e0a2),volume_id=97f1f39b-11fd-4833-a9b0-ad689258e0a2,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:23.854349 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4e959129-11a4-45af-9b8c-45ca96d9ee22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:23.865379 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:10:23.893093 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:10:23.893466 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:10:23.897897 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:23.898250 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:23.898598 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:23.898947 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] Filtering removed all hosts for the request with volume ID '97f1f39b-11fd-4833-a9b0-ad689258e0a2'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:10:23.899290 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] Filtering removed all hosts for the request with volume ID '97f1f39b-11fd-4833-a9b0-ad689258e0a2'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:10:23.899781 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:10:23.900205 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] Creating message record for request_id = req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 Sep 03 21:10:23.917043 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:10:23.917490 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] Setting Volume 97f1f39b-11fd-4833-a9b0-ad689258e0a2 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:10:23.931562 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4e959129-11a4-45af-9b8c-45ca96d9ee22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:23.937490 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-61b25742-f5b4-43ba-a354-a2e2fbd9a8b4 tempest-AttachVolumeShelveTestJSON-1579334333 None] Flow 'volume_create_scheduler' (c212ce2a-3d74-423e-865c-f64f9f555116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:26.712950 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] Flow 'volume_create_scheduler' (45961f2b-29d7-4472-b6ec-bc49df947f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:26.717250 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8912b603-8872-46a0-adf9-dbd64beed6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:26.721348 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8912b603-8872-46a0-adf9-dbd64beed6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7abf3cb3-dbb6-4ea5-85ad-1044861f418e),volume_id=7abf3cb3-dbb6-4ea5-85ad-1044861f418e,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:26.725024 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2caf1194-92d1-4ab8-8941-e3d6c36b476e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:26.733775 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:10:26.749639 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:10:26.750014 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:10:26.750368 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:26.750776 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:26.751739 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:26.752096 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] Filtering removed all hosts for the request with volume ID '7abf3cb3-dbb6-4ea5-85ad-1044861f418e'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:10:26.752442 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] Filtering removed all hosts for the request with volume ID '7abf3cb3-dbb6-4ea5-85ad-1044861f418e'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:10:26.752948 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:10:26.753386 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] Creating message record for request_id = req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 Sep 03 21:10:26.760885 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:10:26.761395 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] Setting Volume 7abf3cb3-dbb6-4ea5-85ad-1044861f418e to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:10:26.783589 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2caf1194-92d1-4ab8-8941-e3d6c36b476e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:26.787510 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-3ba7e600-483b-4e51-9ebf-d40525fd2b92 tempest-VolumesTransfersV357Test-2041366592 None] Flow 'volume_create_scheduler' (45961f2b-29d7-4472-b6ec-bc49df947f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:28.199651 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=74,cinder:UPDATE=14,cinder:INSERT=6,cinder:DELETE=6 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:10:28.249403 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] Flow 'volume_create_scheduler' (1fedb3be-130b-417d-878b-9accbeb75df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:28.261181 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5ca861e6-e322-4642-8032-07350a689681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:28.270123 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5ca861e6-e322-4642-8032-07350a689681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f772893b-0144-4f7f-b5cd-fce5f9b42468),volume_id=f772893b-0144-4f7f-b5cd-fce5f9b42468,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:28.275613 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2e44f4b1-bcd0-4697-bea5-ad6339ba22bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:28.288107 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:10:28.305449 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:10:28.305832 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:10:28.306171 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:28.306510 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:28.306847 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:28.307188 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] Filtering removed all hosts for the request with volume ID 'f772893b-0144-4f7f-b5cd-fce5f9b42468'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:10:28.307528 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] Filtering removed all hosts for the request with volume ID 'f772893b-0144-4f7f-b5cd-fce5f9b42468'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:10:28.308012 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:10:28.308427 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] Creating message record for request_id = req-4c6b399d-7ece-4b5e-964e-31887d38f852 Sep 03 21:10:28.317203 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:10:28.317574 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] Setting Volume f772893b-0144-4f7f-b5cd-fce5f9b42468 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:10:28.329240 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2e44f4b1-bcd0-4697-bea5-ad6339ba22bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:28.332390 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4c6b399d-7ece-4b5e-964e-31887d38f852 tempest-VolumesTransfersV357Test-2041366592 None] Flow 'volume_create_scheduler' (1fedb3be-130b-417d-878b-9accbeb75df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:33.538957 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] Flow 'volume_create_scheduler' (955b1e24-7dfa-417b-818c-0e7f6d3230c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:33.543419 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (790903fc-8bf4-40f6-9315-593d9e13109d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:33.547698 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (790903fc-8bf4-40f6-9315-593d9e13109d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(d8f2b251-a273-4dc8-8459-1813ee78f395),volume_id=d8f2b251-a273-4dc8-8459-1813ee78f395,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:33.551554 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (00a941c8-a62d-496b-9e73-9293b5291258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:33.560416 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:10:33.578291 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:10:33.578739 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:10:33.579891 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:33.580309 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:33.580722 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:33.581163 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] Filtering removed all hosts for the request with volume ID 'd8f2b251-a273-4dc8-8459-1813ee78f395'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:10:33.581575 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] Filtering removed all hosts for the request with volume ID 'd8f2b251-a273-4dc8-8459-1813ee78f395'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:10:33.582133 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:10:33.582659 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] Creating message record for request_id = req-c725ff50-478f-45ba-a571-5ba145f905c5 Sep 03 21:10:33.590582 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:10:33.591051 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] Setting Volume d8f2b251-a273-4dc8-8459-1813ee78f395 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:10:33.601931 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (00a941c8-a62d-496b-9e73-9293b5291258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:33.605177 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-c725ff50-478f-45ba-a571-5ba145f905c5 tempest-VolumesListTestJSON-1666789646 None] Flow 'volume_create_scheduler' (955b1e24-7dfa-417b-818c-0e7f6d3230c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:37.318697 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] Flow 'volume_create_scheduler' (45c1f2b9-75c3-40e2-aec1-3e0b9025a1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:37.322782 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2934421c-6b8d-4af7-9987-d6a7e2132c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:37.326656 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2934421c-6b8d-4af7-9987-d6a7e2132c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(555747fe-b46a-4d9e-ac97-d78c20659980),volume_id=555747fe-b46a-4d9e-ac97-d78c20659980,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:37.330884 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (209c6ea1-7cab-4748-a1fc-8e64ab25c512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:37.339696 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:10:37.358291 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:10:37.358291 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:10:37.358291 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:37.358291 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:37.358291 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:37.358291 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] Filtering removed all hosts for the request with volume ID '555747fe-b46a-4d9e-ac97-d78c20659980'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:10:37.358291 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] Filtering removed all hosts for the request with volume ID '555747fe-b46a-4d9e-ac97-d78c20659980'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:10:37.358291 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:10:37.358291 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] Creating message record for request_id = req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 Sep 03 21:10:37.363419 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:10:37.363946 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] Setting Volume 555747fe-b46a-4d9e-ac97-d78c20659980 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:10:37.374930 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (209c6ea1-7cab-4748-a1fc-8e64ab25c512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:37.378778 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-2d2c7125-9b51-43bb-a9db-a66556bf55f4 tempest-VolumesNegativeTest-68769053 None] Flow 'volume_create_scheduler' (45c1f2b9-75c3-40e2-aec1-3e0b9025a1b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:37.973149 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-67b77083-5693-46cd-a125-83c1defee3a3 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:10:40.967401 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] Flow 'volume_create_scheduler' (c4934500-8e84-4870-94ed-50b3b88d5d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:40.975798 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (76b954f3-6ffd-4efc-a5d3-e65127e9d931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:40.988832 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (76b954f3-6ffd-4efc-a5d3-e65127e9d931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(12c8fe2c-5f3a-434b-a572-6befc20b2812),volume_id=12c8fe2c-5f3a-434b-a572-6befc20b2812,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:40.993566 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cbbe12b1-a0df-44b5-b45c-b8ebd910ddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:41.004773 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:10:41.019796 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:10:41.020118 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:10:41.020597 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:41.021417 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:41.022204 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:41.022831 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] Filtering removed all hosts for the request with volume ID '12c8fe2c-5f3a-434b-a572-6befc20b2812'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:10:41.023794 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] Filtering removed all hosts for the request with volume ID '12c8fe2c-5f3a-434b-a572-6befc20b2812'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:10:41.025148 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:10:41.026221 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] Creating message record for request_id = req-a6ff9914-e154-4abf-a1cb-af59dff5625c Sep 03 21:10:41.035045 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:10:41.035616 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] Setting Volume 12c8fe2c-5f3a-434b-a572-6befc20b2812 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:10:41.055225 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cbbe12b1-a0df-44b5-b45c-b8ebd910ddfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:41.058374 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-a6ff9914-e154-4abf-a1cb-af59dff5625c tempest-VolumesSnapshotNegativeTestJSON-1146901633 None] Flow 'volume_create_scheduler' (c4934500-8e84-4870-94ed-50b3b88d5d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:52.156431 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] Flow 'volume_create_scheduler' (5117f514-48ae-4029-a046-48ca02a5996d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:10:52.162444 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (314da190-313b-45b0-b87f-5dabca476df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:52.166658 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (314da190-313b-45b0-b87f-5dabca476df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bc268982-bcac-4a9f-a9c8-c7b35b4c00d6),volume_id=bc268982-bcac-4a9f-a9c8-c7b35b4c00d6,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:52.173160 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e857b276-93f9-4fb4-af29-1399fe5a69d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:10:52.189652 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:10:52.206567 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:10:52.207247 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:10:52.207789 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:52.208348 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:52.209289 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:10:52.209868 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] Filtering removed all hosts for the request with volume ID 'bc268982-bcac-4a9f-a9c8-c7b35b4c00d6'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:10:52.210418 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] Filtering removed all hosts for the request with volume ID 'bc268982-bcac-4a9f-a9c8-c7b35b4c00d6'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:10:52.211621 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:10:52.212331 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] Creating message record for request_id = req-1c72d51e-a6af-482d-a8f4-44066c115776 Sep 03 21:10:52.222167 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:10:52.222526 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] Setting Volume bc268982-bcac-4a9f-a9c8-c7b35b4c00d6 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:10:52.252854 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e857b276-93f9-4fb4-af29-1399fe5a69d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:10:52.256768 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1c72d51e-a6af-482d-a8f4-44066c115776 tempest-AttachVolumeNegativeTest-66898911 None] Flow 'volume_create_scheduler' (5117f514-48ae-4029-a046-48ca02a5996d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:11:02.584236 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=13,cinder:SELECT=62,cinder:INSERT=5,cinder:DELETE=5 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:37.969614 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-9b3ad31a-e201-4848-a139-385120fd95d3 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:11:42.585184 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:11:46.833547 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-f83a63c1-fad6-4eff-b93c-107f9d71e712 tempest-GroupSnapshotsV319Test-71430368 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:11:46.839678 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-f83a63c1-fad6-4eff-b93c-107f9d71e712 tempest-GroupSnapshotsV319Test-71430368 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:11:46.840145 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.manager [None req-f83a63c1-fad6-4eff-b93c-107f9d71e712 tempest-GroupSnapshotsV319Test-71430368 None] Could not find a backend for group 40c95a05-0c3b-457b-9855-757826b4e205.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:11:51.128083 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-77fae0cf-fb78-444e-a392-212ed7bb0631 tempest-GroupsV314Test-140310084 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:11:51.128083 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-77fae0cf-fb78-444e-a392-212ed7bb0631 tempest-GroupsV314Test-140310084 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:11:51.128083 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.manager [None req-77fae0cf-fb78-444e-a392-212ed7bb0631 tempest-GroupsV314Test-140310084 None] Could not find a backend for group f2594d4b-f2f6-4437-a0d6-b61df8e07160.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:11:54.049667 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] Flow 'volume_create_scheduler' (4af6a342-65be-4eda-8f0c-e6ad63f3ba91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:11:54.054768 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (78dc2fa2-725c-4b4b-b8f0-4c0212770c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:11:54.059149 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (78dc2fa2-725c-4b4b-b8f0-4c0212770c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f3873303-1a96-4d50-9111-7b19437d6b4b),volume_id=f3873303-1a96-4d50-9111-7b19437d6b4b,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:11:54.064445 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (444b4c6a-eb54-4efa-830f-c395eebb1e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:11:54.072592 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:11:54.091584 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:11:54.091951 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:11:54.092488 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:11:54.093067 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:11:54.093549 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:11:54.093896 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] Filtering removed all hosts for the request with volume ID 'f3873303-1a96-4d50-9111-7b19437d6b4b'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:11:54.094234 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] Filtering removed all hosts for the request with volume ID 'f3873303-1a96-4d50-9111-7b19437d6b4b'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:11:54.094712 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:11:54.095131 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] Creating message record for request_id = req-104953d1-6e1b-4775-89d9-76bea15e0e8f Sep 03 21:11:54.102234 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:11:54.102747 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] Setting Volume f3873303-1a96-4d50-9111-7b19437d6b4b to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:11:54.114477 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (444b4c6a-eb54-4efa-830f-c395eebb1e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:11:54.118357 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-104953d1-6e1b-4775-89d9-76bea15e0e8f tempest-AttachVolumeShelveTestJSON-1579334333 None] Flow 'volume_create_scheduler' (4af6a342-65be-4eda-8f0c-e6ad63f3ba91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:11:55.170050 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-fe7df907-4d04-4160-8076-6bd298a22b3f tempest-VolumePoolsAdminTestsJSON-1738661252 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:11:55.228628 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-dcea75c9-3a80-47bd-aad3-0a3879ccb135 tempest-VolumePoolsAdminTestsJSON-1738661252 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:11:59.971439 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] Flow 'volume_create_scheduler' (1bdf6e81-c4fe-4cd0-a3bc-3c16d41104d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:11:59.991595 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5692939f-ad32-47bd-8bdf-3807ee6c6aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:11:59.995691 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5692939f-ad32-47bd-8bdf-3807ee6c6aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(055ec293-4ecb-4118-a45d-b06c3a86ee1a),volume_id=055ec293-4ecb-4118-a45d-b06c3a86ee1a,volume_properties=VolumeProperties,volume_type=VolumeType(6b06314a-370a-48d2-8131-8a66bb4b51c0))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:11:59.999228 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d2d1a60e-08ad-4f05-8324-d8886bf4feb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:12:00.007850 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:12:00.022358 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:12:00.022926 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:12:00.023602 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:12:00.024117 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:12:00.024644 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:12:00.025193 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] Filtering removed all hosts for the request with volume ID '055ec293-4ecb-4118-a45d-b06c3a86ee1a'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:12:00.025714 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] Filtering removed all hosts for the request with volume ID '055ec293-4ecb-4118-a45d-b06c3a86ee1a'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:12:00.026376 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] No weighed backend found for volume with properties: {'id': '6b06314a-370a-48d2-8131-8a66bb4b51c0', 'name': 'tempest-VolumeTypesTest-volume-type-591649274', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'}, 'qos_specs_id': None, 'created_at': '2022-09-03T21:11:59.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:12:00.026994 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] Creating message record for request_id = req-091f37e9-4ede-4fdb-82ba-c1989d76c15d Sep 03 21:12:00.036093 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:12:00.038000 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] Setting Volume 055ec293-4ecb-4118-a45d-b06c3a86ee1a to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:12:00.056510 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d2d1a60e-08ad-4f05-8324-d8886bf4feb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:12:00.060508 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-091f37e9-4ede-4fdb-82ba-c1989d76c15d tempest-VolumeTypesTest-789719129 None] Flow 'volume_create_scheduler' (1bdf6e81-c4fe-4cd0-a3bc-3c16d41104d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:12:12.597241 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=45,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=2 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:35.403100 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] Flow 'volume_create_scheduler' (d7f34353-245f-4452-8761-52958cf866d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:12:35.412927 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fc466c05-2738-4d21-b360-aa25cbf6ea40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:12:35.421295 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fc466c05-2738-4d21-b360-aa25cbf6ea40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(1227173c-b95e-4599-b984-92d413862652),volume_id=1227173c-b95e-4599-b984-92d413862652,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:12:35.424747 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a834d917-4257-40ac-8a01-c16bd62455c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:12:35.452593 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:12:35.476956 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:12:35.477517 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:12:35.477877 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:12:35.478241 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:12:35.478572 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:12:35.478933 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] Filtering removed all hosts for the request with volume ID '1227173c-b95e-4599-b984-92d413862652'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:12:35.479286 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] Filtering removed all hosts for the request with volume ID '1227173c-b95e-4599-b984-92d413862652'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:12:35.479783 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:12:35.480216 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] Creating message record for request_id = req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c Sep 03 21:12:35.492045 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:12:35.492525 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] Setting Volume 1227173c-b95e-4599-b984-92d413862652 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:12:35.505010 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a834d917-4257-40ac-8a01-c16bd62455c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:12:35.508149 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ceddf7a5-dd5f-4fb3-964d-2aebfbd99d8c tempest-AttachVolumeNegativeTest-66898911 None] Flow 'volume_create_scheduler' (d7f34353-245f-4452-8761-52958cf866d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:12:37.974782 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-77589ebf-ff11-4e2c-84e0-cf10cafcef81 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:12:52.594077 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:57.604178 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] Flow 'volume_create_scheduler' (bc138ece-6c8e-48d5-86c0-dd9afcb2da0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:12:57.609146 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6480a5bd-c5d7-4096-a4fd-aff558405cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:12:57.613477 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6480a5bd-c5d7-4096-a4fd-aff558405cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(71daf534-66b3-4647-8017-69ab038feb6f),volume_id=71daf534-66b3-4647-8017-69ab038feb6f,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:12:57.616970 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3867a087-24db-4655-ac4e-7b604bbd8a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:12:57.625990 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:12:57.641709 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:12:57.642268 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:12:57.642724 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:12:57.643174 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:12:57.643695 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:12:57.652935 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] Filtering removed all hosts for the request with volume ID '71daf534-66b3-4647-8017-69ab038feb6f'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:12:57.652935 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] Filtering removed all hosts for the request with volume ID '71daf534-66b3-4647-8017-69ab038feb6f'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:12:57.652935 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:12:57.652935 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] Creating message record for request_id = req-9937f423-6a50-43a4-ae55-f904a663a81d Sep 03 21:12:57.656770 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:12:57.657470 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] Setting Volume 71daf534-66b3-4647-8017-69ab038feb6f to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:12:57.672263 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3867a087-24db-4655-ac4e-7b604bbd8a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:12:57.678126 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [req-3e7b887a-3228-48f3-803d-cd957d866137 req-9937f423-6a50-43a4-ae55-f904a663a81d tempest-VolumesGetTestJSON-1417456213 None] Flow 'volume_create_scheduler' (bc138ece-6c8e-48d5-86c0-dd9afcb2da0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:13:32.611489 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:37.970860 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-a2e54fae-4339-42d9-b82c-fb98e1db85ad None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:14:12.618175 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:28.068075 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] Flow 'volume_create_scheduler' (1d0fbb2d-dc18-481c-b24d-0d4201592669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:14:28.075352 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (35fe3e2a-9168-4aad-99d7-b6827fee5327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:14:28.081503 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (35fe3e2a-9168-4aad-99d7-b6827fee5327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(1cdea528-7365-4cff-b6ef-92a7fc5199d6),volume_id=1cdea528-7365-4cff-b6ef-92a7fc5199d6,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:14:28.084968 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1b372942-5fc1-4908-8d7b-c3f50d9a44a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:14:28.108809 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:14:28.126887 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:14:28.127523 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:14:28.128066 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:14:28.128546 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:14:28.129686 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:14:28.130206 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] Filtering removed all hosts for the request with volume ID '1cdea528-7365-4cff-b6ef-92a7fc5199d6'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:14:28.130676 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] Filtering removed all hosts for the request with volume ID '1cdea528-7365-4cff-b6ef-92a7fc5199d6'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:14:28.131293 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:14:28.132213 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] Creating message record for request_id = req-94f6cbfd-9ebd-4526-af71-66829df39ee8 Sep 03 21:14:28.140660 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:14:28.141221 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] Setting Volume 1cdea528-7365-4cff-b6ef-92a7fc5199d6 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:14:28.160945 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1b372942-5fc1-4908-8d7b-c3f50d9a44a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:14:28.164495 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-94f6cbfd-9ebd-4526-af71-66829df39ee8 tempest-ServersNegativeTestJSON-557566260 None] Flow 'volume_create_scheduler' (1d0fbb2d-dc18-481c-b24d-0d4201592669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:14:30.291848 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] Flow 'volume_create_scheduler' (e4e965de-e62e-4f3c-97f0-bbbac5ca8c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:14:30.298477 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (385e861e-0a2b-4c11-a1cc-71f6709bcc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:14:30.302985 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (385e861e-0a2b-4c11-a1cc-71f6709bcc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e20600ab-d834-42ae-ae12-d70224b50268),volume_id=e20600ab-d834-42ae-ae12-d70224b50268,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:14:30.307663 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (09285c4a-69b6-47f0-bebb-40c0d886deaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:14:30.323288 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:14:30.350147 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:14:30.350512 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:14:30.350924 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:14:30.351268 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:14:30.351603 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:14:30.351948 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] Filtering removed all hosts for the request with volume ID 'e20600ab-d834-42ae-ae12-d70224b50268'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:14:30.352285 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] Filtering removed all hosts for the request with volume ID 'e20600ab-d834-42ae-ae12-d70224b50268'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:14:30.352766 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:14:30.353680 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] Creating message record for request_id = req-2dff7483-7c4d-4469-92e7-b1385caed936 Sep 03 21:14:30.364183 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:14:30.364582 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] Setting Volume e20600ab-d834-42ae-ae12-d70224b50268 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:14:30.377956 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (09285c4a-69b6-47f0-bebb-40c0d886deaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:14:30.381839 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-2dff7483-7c4d-4469-92e7-b1385caed936 tempest-ServersNegativeTestJSON-557566260 None] Flow 'volume_create_scheduler' (e4e965de-e62e-4f3c-97f0-bbbac5ca8c01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:14:37.973503 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-d479c71b-bbb4-4adb-9db6-0da19d4afb12 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:14:52.633515 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=34,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=2 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:15.610972 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] Flow 'volume_create_scheduler' (449d6219-2385-40fe-b33a-ffa0b70a5f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:15:15.618979 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c6896574-f728-4698-8723-1a9aaf5e2dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:15.626324 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c6896574-f728-4698-8723-1a9aaf5e2dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(26702190-1054-4195-8295-582a2795f77b),volume_id=26702190-1054-4195-8295-582a2795f77b,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:15.631380 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (24c938b2-a96b-4023-ad17-209cec514c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:15.645035 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:15:15.670360 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:15:15.671118 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:15:15.671679 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:15.672230 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:15.672794 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:15.673370 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] Filtering removed all hosts for the request with volume ID '26702190-1054-4195-8295-582a2795f77b'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:15:15.674284 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] Filtering removed all hosts for the request with volume ID '26702190-1054-4195-8295-582a2795f77b'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:15:15.675186 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:15:15.675955 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] Creating message record for request_id = req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 Sep 03 21:15:15.687480 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:15:15.688418 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] Setting Volume 26702190-1054-4195-8295-582a2795f77b to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:15:15.732225 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (24c938b2-a96b-4023-ad17-209cec514c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:15.736475 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-33d8b3f3-63b8-4ff0-bfcc-ce13d8852d02 tempest-SnapshotsActionsTest-753050719 None] Flow 'volume_create_scheduler' (449d6219-2385-40fe-b33a-ffa0b70a5f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:15:25.513981 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:25.592286 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Flow 'volume_create_scheduler' (d697b6c3-c0ce-463f-adb0-5f357a84cdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:15:25.599518 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f7c96c5e-2441-40fa-bd63-2aa40220825b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:25.607379 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f7c96c5e-2441-40fa-bd63-2aa40220825b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(340885fa-882f-4d3e-9561-f9fecd144346),volume_id=340885fa-882f-4d3e-9561-f9fecd144346,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:25.614210 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (19c3203d-cfea-4ded-9c01-842078610403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:25.624972 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:15:25.650097 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:15:25.650523 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:15:25.651504 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:25.651932 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:25.652475 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:25.652888 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Filtering removed all hosts for the request with volume ID '340885fa-882f-4d3e-9561-f9fecd144346'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:15:25.655280 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Filtering removed all hosts for the request with volume ID '340885fa-882f-4d3e-9561-f9fecd144346'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:15:25.655895 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:15:25.656421 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Creating message record for request_id = req-cdda08db-1945-43ef-a24a-a412a4aa7206 Sep 03 21:15:25.690652 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:15:25.692830 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Setting Volume 340885fa-882f-4d3e-9561-f9fecd144346 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:15:25.740934 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (19c3203d-cfea-4ded-9c01-842078610403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:25.759529 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-cdda08db-1945-43ef-a24a-a412a4aa7206 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Flow 'volume_create_scheduler' (d697b6c3-c0ce-463f-adb0-5f357a84cdf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:15:27.789655 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Flow 'volume_create_scheduler' (8229ccaf-ce1b-4aae-a5ea-df127010e9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:15:27.799976 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (51e7fafa-021e-46ea-a9d6-999ea19e6f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:27.809092 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (51e7fafa-021e-46ea-a9d6-999ea19e6f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(21d52baa-69e0-4446-9c26-2f6d2f8066e8),volume_id=21d52baa-69e0-4446-9c26-2f6d2f8066e8,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:27.836857 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5499c938-b2fc-4b91-9742-af1015750984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:27.855730 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:15:27.881534 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:15:27.882074 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:15:27.882518 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:27.883006 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:27.883442 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:27.888378 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Filtering removed all hosts for the request with volume ID '21d52baa-69e0-4446-9c26-2f6d2f8066e8'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:15:27.889558 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Filtering removed all hosts for the request with volume ID '21d52baa-69e0-4446-9c26-2f6d2f8066e8'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:15:27.890320 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:15:27.893673 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Creating message record for request_id = req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 Sep 03 21:15:27.906259 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:15:27.907005 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Setting Volume 21d52baa-69e0-4446-9c26-2f6d2f8066e8 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:15:27.942929 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5499c938-b2fc-4b91-9742-af1015750984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:27.947401 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-45fbbc83-2b64-4c3c-bc91-bbea5675abd1 tempest-VolumeQuotasAdminTestJSON-1904032513 None] Flow 'volume_create_scheduler' (8229ccaf-ce1b-4aae-a5ea-df127010e9a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:15:37.971023 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-f1229e3b-bb04-48f4-9922-13a51d334f9f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:15:42.867402 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] Flow 'volume_create_scheduler' (f8212ebd-a550-4c54-8025-7b19ce613c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:15:42.881987 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f85e543f-a727-4d7f-8ae4-c3f1bad35fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:42.888953 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f85e543f-a727-4d7f-8ae4-c3f1bad35fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(27bf95ff-1f06-4248-b262-bf0774b3d44c),volume_id=27bf95ff-1f06-4248-b262-bf0774b3d44c,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:42.894179 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e36c24ec-735f-4a84-baf3-fa5335db8164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:42.905084 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:15:42.922073 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:15:42.922465 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:15:42.922859 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:42.925361 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:42.926498 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:42.927933 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] Filtering removed all hosts for the request with volume ID '27bf95ff-1f06-4248-b262-bf0774b3d44c'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:15:42.929040 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] Filtering removed all hosts for the request with volume ID '27bf95ff-1f06-4248-b262-bf0774b3d44c'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:15:42.930285 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:15:42.932038 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] Creating message record for request_id = req-92d74043-e6f0-486f-870c-abf615b21a16 Sep 03 21:15:42.960073 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:15:42.962609 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] Setting Volume 27bf95ff-1f06-4248-b262-bf0774b3d44c to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:15:43.002709 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e36c24ec-735f-4a84-baf3-fa5335db8164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:43.018416 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-92d74043-e6f0-486f-870c-abf615b21a16 tempest-VolumesImageMetadata-224097338 None] Flow 'volume_create_scheduler' (f8212ebd-a550-4c54-8025-7b19ce613c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:15:47.898761 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] Flow 'volume_create_scheduler' (b50e45bf-5b6c-46a3-810d-a53ad6dc1700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:15:47.903983 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0f2e8abe-c52a-48d3-ad7b-4d4dc7a5c165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:47.909279 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0f2e8abe-c52a-48d3-ad7b-4d4dc7a5c165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(707781fc-dbf2-4b12-b32d-e63048235c8d),volume_id=707781fc-dbf2-4b12-b32d-e63048235c8d,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:47.913941 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7139c2ab-0191-40b4-80c4-9912905104d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:47.923925 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:15:47.940691 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:15:47.941323 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:15:47.941676 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:47.942026 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:47.942368 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:47.942904 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] Filtering removed all hosts for the request with volume ID '707781fc-dbf2-4b12-b32d-e63048235c8d'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:15:47.943252 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] Filtering removed all hosts for the request with volume ID '707781fc-dbf2-4b12-b32d-e63048235c8d'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:15:47.943739 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:15:47.944167 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] Creating message record for request_id = req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 Sep 03 21:15:47.953549 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:15:47.953936 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] Setting Volume 707781fc-dbf2-4b12-b32d-e63048235c8d to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:15:47.978058 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7139c2ab-0191-40b4-80c4-9912905104d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:47.985729 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-bb1fa84b-5ecb-4ef7-85b7-a297263d2221 tempest-VolumesExtendTest-332323825 None] Flow 'volume_create_scheduler' (b50e45bf-5b6c-46a3-810d-a53ad6dc1700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:15:49.753741 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] Flow 'volume_create_scheduler' (2492150c-d61d-4571-887a-faf87049c622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:15:49.763774 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b174d773-7dd3-49d9-b024-0cb3b7425934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:49.787711 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b174d773-7dd3-49d9-b024-0cb3b7425934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(d3717cdd-dd43-4ab4-ad49-b808e576c458),volume_id=d3717cdd-dd43-4ab4-ad49-b808e576c458,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:49.791432 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6672fe69-89dc-4945-8c4c-f3987442e854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:49.823523 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:15:49.855313 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:15:49.855682 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:15:49.856036 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:49.856384 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:49.866625 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:49.867394 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] Filtering removed all hosts for the request with volume ID 'd3717cdd-dd43-4ab4-ad49-b808e576c458'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:15:49.867979 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] Filtering removed all hosts for the request with volume ID 'd3717cdd-dd43-4ab4-ad49-b808e576c458'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:15:49.868696 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:15:49.871122 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] Creating message record for request_id = req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 Sep 03 21:15:49.889542 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:15:49.891429 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] Setting Volume d3717cdd-dd43-4ab4-ad49-b808e576c458 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:15:49.917011 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6672fe69-89dc-4945-8c4c-f3987442e854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:49.923755 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-1c37e2cc-019d-454b-acfd-1da3f14e0c04 tempest-VolumesExtendTest-332323825 None] Flow 'volume_create_scheduler' (2492150c-d61d-4571-887a-faf87049c622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:15:57.472754 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=64,cinder:UPDATE=13,cinder:INSERT=5,cinder:DELETE=5 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:57.555014 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] Flow 'volume_create_scheduler' (5e6bfa57-50d3-4eac-9750-dd41150a0988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:15:57.564868 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5b3bd4c5-e2a7-4ef4-94c2-145d6dcb9b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:57.587396 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5b3bd4c5-e2a7-4ef4-94c2-145d6dcb9b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9909356e-22bb-42ae-a100-2087480b78dd),volume_id=9909356e-22bb-42ae-a100-2087480b78dd,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:57.587396 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a074dda2-f487-44ea-9325-25dcb18af87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:57.605929 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:15:57.641433 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:15:57.646047 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:15:57.646551 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:57.647029 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:57.647480 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:57.647937 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] Filtering removed all hosts for the request with volume ID '9909356e-22bb-42ae-a100-2087480b78dd'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:15:57.648391 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] Filtering removed all hosts for the request with volume ID '9909356e-22bb-42ae-a100-2087480b78dd'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:15:57.651079 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:15:57.651637 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] Creating message record for request_id = req-a581e23d-cb3c-4d22-87c2-950f137c5660 Sep 03 21:15:57.663503 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:15:57.663984 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] Setting Volume 9909356e-22bb-42ae-a100-2087480b78dd to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:15:57.682200 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a074dda2-f487-44ea-9325-25dcb18af87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:57.695228 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-a581e23d-cb3c-4d22-87c2-950f137c5660 tempest-VolumesGetTest-2030605297 None] Flow 'volume_create_scheduler' (5e6bfa57-50d3-4eac-9750-dd41150a0988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:15:59.871117 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] Flow 'volume_create_scheduler' (8219faab-034d-4168-bdff-c0f045a2d9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:15:59.884217 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ab74c04b-d3e2-476d-8a94-7237f7a76cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:59.889574 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ab74c04b-d3e2-476d-8a94-7237f7a76cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(510acf0d-2672-4140-ae2c-0e47161fd578),volume_id=510acf0d-2672-4140-ae2c-0e47161fd578,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:59.896103 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bffce46d-7fdf-466b-8e07-79bfd6719bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:15:59.911973 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:15:59.932028 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:15:59.933822 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:15:59.934917 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:59.935869 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:59.936808 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:15:59.937784 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] Filtering removed all hosts for the request with volume ID '510acf0d-2672-4140-ae2c-0e47161fd578'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:15:59.938710 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] Filtering removed all hosts for the request with volume ID '510acf0d-2672-4140-ae2c-0e47161fd578'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:15:59.940607 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:15:59.942515 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] Creating message record for request_id = req-0d70d771-5962-4ec6-a370-79f5351d9acf Sep 03 21:15:59.955714 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:15:59.956666 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] Setting Volume 510acf0d-2672-4140-ae2c-0e47161fd578 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:15:59.981143 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bffce46d-7fdf-466b-8e07-79bfd6719bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:15:59.987692 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0d70d771-5962-4ec6-a370-79f5351d9acf tempest-VolumesGetTest-2030605297 None] Flow 'volume_create_scheduler' (8219faab-034d-4168-bdff-c0f045a2d9fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:16:01.428199 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] Flow 'volume_create_scheduler' (6d74086d-ba15-4dc0-976c-b129e27fef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:16:01.436055 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0ee85d1f-268a-43ce-a76f-d09a8738837e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:16:01.449483 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0ee85d1f-268a-43ce-a76f-d09a8738837e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(d019eae3-3710-4c44-aeb8-d5252996fe0f),volume_id=d019eae3-3710-4c44-aeb8-d5252996fe0f,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:16:01.454852 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (762ea2ed-fd1c-41f3-9604-ec206a02020f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:16:01.466182 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:16:01.535239 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:16:01.535828 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:16:01.540494 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:01.542781 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:01.543339 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:01.545195 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] Filtering removed all hosts for the request with volume ID 'd019eae3-3710-4c44-aeb8-d5252996fe0f'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:16:01.545707 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] Filtering removed all hosts for the request with volume ID 'd019eae3-3710-4c44-aeb8-d5252996fe0f'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:16:01.547747 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:16:01.549670 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] Creating message record for request_id = req-e1024086-0e62-4098-9400-f567392c9a41 Sep 03 21:16:01.571222 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:16:01.572328 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] Setting Volume d019eae3-3710-4c44-aeb8-d5252996fe0f to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:16:01.607269 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (762ea2ed-fd1c-41f3-9604-ec206a02020f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:16:01.617987 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e1024086-0e62-4098-9400-f567392c9a41 tempest-TestVolumeBootPattern-809940440 None] Flow 'volume_create_scheduler' (6d74086d-ba15-4dc0-976c-b129e27fef24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:16:01.776330 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] Flow 'volume_create_scheduler' (c9f4117b-4d11-442f-bb6e-10467b00492a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:16:01.785468 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4af7991c-8e63-4162-bb65-678d861c4ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:16:01.801811 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4af7991c-8e63-4162-bb65-678d861c4ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(33374781-af19-4a95-8b31-1685f6e04abc),volume_id=33374781-af19-4a95-8b31-1685f6e04abc,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:16:01.811213 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4887f1dc-42dc-48e5-8f2b-4667f2f3c352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:16:01.821042 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:16:01.843154 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:16:01.843777 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:16:01.844208 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:01.844800 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:01.845229 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:01.845627 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] Filtering removed all hosts for the request with volume ID '33374781-af19-4a95-8b31-1685f6e04abc'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:16:01.849027 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] Filtering removed all hosts for the request with volume ID '33374781-af19-4a95-8b31-1685f6e04abc'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:16:01.849609 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:16:01.850146 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] Creating message record for request_id = req-465d238f-13fe-43a2-af97-93481443fb05 Sep 03 21:16:01.858844 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:16:01.859586 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] Setting Volume 33374781-af19-4a95-8b31-1685f6e04abc to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:16:01.874335 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4887f1dc-42dc-48e5-8f2b-4667f2f3c352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:16:01.877585 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-465d238f-13fe-43a2-af97-93481443fb05 tempest-VolumesGetTest-2030605297 None] Flow 'volume_create_scheduler' (c9f4117b-4d11-442f-bb6e-10467b00492a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:16:03.454212 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] Flow 'volume_create_scheduler' (85caf2b8-abc7-4982-9f60-4257d1442ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:16:03.461829 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c86291d6-3a5d-4d68-923c-cd7ff18a9d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:16:03.471719 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c86291d6-3a5d-4d68-923c-cd7ff18a9d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(265e25a0-b61f-4838-b99c-4dc2188b1be7),volume_id=265e25a0-b61f-4838-b99c-4dc2188b1be7,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:16:03.483699 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ba7b7647-7f9c-45a2-96d6-e8035a1a2616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:16:03.497734 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:16:03.527425 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:16:03.527802 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:16:03.528153 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:03.528498 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:03.528842 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:03.529219 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] Filtering removed all hosts for the request with volume ID '265e25a0-b61f-4838-b99c-4dc2188b1be7'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:16:03.529561 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] Filtering removed all hosts for the request with volume ID '265e25a0-b61f-4838-b99c-4dc2188b1be7'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:16:03.530049 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:16:03.530470 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] Creating message record for request_id = req-f98ba8a0-f54c-4b08-b967-ab0b57628957 Sep 03 21:16:03.551563 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:16:03.552044 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] Setting Volume 265e25a0-b61f-4838-b99c-4dc2188b1be7 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:16:03.565476 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ba7b7647-7f9c-45a2-96d6-e8035a1a2616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:16:03.569332 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-f98ba8a0-f54c-4b08-b967-ab0b57628957 tempest-TestVolumeBootPattern-809940440 None] Flow 'volume_create_scheduler' (85caf2b8-abc7-4982-9f60-4257d1442ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:16:07.080507 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] Flow 'volume_create_scheduler' (1b3ae783-0727-4c59-be75-0eb5bb5db853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:16:07.086047 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c52519cf-ae0f-45c6-8850-c09803c4de77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:16:07.091187 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c52519cf-ae0f-45c6-8850-c09803c4de77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(341b84b1-771a-4b36-8511-862d7d474316),volume_id=341b84b1-771a-4b36-8511-862d7d474316,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:16:07.095076 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0490e869-0f83-4eb7-9c87-63b4f6a8d0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:16:07.104127 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:16:07.137485 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:16:07.138005 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:16:07.138515 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:07.139091 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:07.139873 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:07.140369 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] Filtering removed all hosts for the request with volume ID '341b84b1-771a-4b36-8511-862d7d474316'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:16:07.140965 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] Filtering removed all hosts for the request with volume ID '341b84b1-771a-4b36-8511-862d7d474316'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:16:07.141719 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:16:07.142485 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] Creating message record for request_id = req-276335f8-846c-4f68-ab11-54fe773a8a17 Sep 03 21:16:07.152223 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:16:07.157388 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] Setting Volume 341b84b1-771a-4b36-8511-862d7d474316 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:16:07.173725 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0490e869-0f83-4eb7-9c87-63b4f6a8d0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:16:07.180991 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-276335f8-846c-4f68-ab11-54fe773a8a17 tempest-TestVolumeBootPattern-809940440 None] Flow 'volume_create_scheduler' (1b3ae783-0727-4c59-be75-0eb5bb5db853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:16:22.632409 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=74,cinder:UPDATE=14,cinder:INSERT=6,cinder:DELETE=6 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:37.966904 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-f06d123e-3b83-413e-a5e2-fbd8d80d873b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:16:40.377455 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-3e7e3b4d-68e0-4f05-8013-bb2a01b5b12b tempest-GroupsTest-1951785779 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:16:40.394192 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-3e7e3b4d-68e0-4f05-8013-bb2a01b5b12b tempest-GroupsTest-1951785779 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:16:40.394725 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.manager [None req-3e7e3b4d-68e0-4f05-8013-bb2a01b5b12b tempest-GroupsTest-1951785779 None] Could not find a backend for group db7ac2f9-0908-4e07-ba0e-ab73a61cf5e1.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:16:41.925580 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-a7e70a54-8e86-443d-a8d4-0bb0c73fae94 tempest-GroupsTest-1951785779 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:16:41.932546 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-a7e70a54-8e86-443d-a8d4-0bb0c73fae94 tempest-GroupsTest-1951785779 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:16:41.933101 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.manager [None req-a7e70a54-8e86-443d-a8d4-0bb0c73fae94 tempest-GroupsTest-1951785779 None] Could not find a backend for group d21db3fa-7b1f-4e2b-b542-cbed1fb8ae8e.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:16:52.650181 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=5,cinder:SELECT=16 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:53.799309 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] Flow 'volume_create_scheduler' (19e74232-080a-412c-bcb4-cf539e0036a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:16:53.804004 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0a05662a-cd46-4228-a36e-8dfc6088c5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:16:53.808630 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0a05662a-cd46-4228-a36e-8dfc6088c5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4dcab59b-10e6-4875-8cc8-64ee5f277156),volume_id=4dcab59b-10e6-4875-8cc8-64ee5f277156,volume_properties=VolumeProperties,volume_type=VolumeType(13c03d6b-8477-466c-8593-3ea50496788b))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:16:53.812692 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6d66ca89-7e53-4455-b0ca-d3955ee148eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:16:53.826811 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:16:53.855700 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:16:53.856002 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:16:53.856346 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:53.856864 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:53.857546 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:53.858395 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] Filtering removed all hosts for the request with volume ID '4dcab59b-10e6-4875-8cc8-64ee5f277156'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:16:53.859192 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] Filtering removed all hosts for the request with volume ID '4dcab59b-10e6-4875-8cc8-64ee5f277156'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:16:53.859961 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] No weighed backend found for volume with properties: {'id': '13c03d6b-8477-466c-8593-3ea50496788b', 'name': 'volume-type-1', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {}, 'qos_specs_id': None, 'created_at': '2022-09-03T21:16:53.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:16:53.860390 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] Creating message record for request_id = req-7f5b4533-2190-4f3f-81de-f4e61542072f Sep 03 21:16:53.872373 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:16:53.872953 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] Setting Volume 4dcab59b-10e6-4875-8cc8-64ee5f277156 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:16:53.892274 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6d66ca89-7e53-4455-b0ca-d3955ee148eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:16:53.900381 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-7f5b4533-2190-4f3f-81de-f4e61542072f tempest-VolumeRetypeWithoutMigrationTest-987626691 None] Flow 'volume_create_scheduler' (19e74232-080a-412c-bcb4-cf539e0036a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:16:58.169591 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] Flow 'volume_create_scheduler' (21706f42-2a83-46c2-94b6-83995d5bda11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:16:58.174441 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c82b1d2c-94ff-4b22-9606-6a05436aed5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:16:58.178613 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c82b1d2c-94ff-4b22-9606-6a05436aed5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ef0993c7-a17e-4531-95e7-d09b0bbf13ba),volume_id=ef0993c7-a17e-4531-95e7-d09b0bbf13ba,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:16:58.182206 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b612292f-857a-4f7d-b615-b4fd345b2cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:16:58.191784 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:16:58.206564 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:16:58.206940 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:16:58.207287 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:58.207632 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:58.207960 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:16:58.208317 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] Filtering removed all hosts for the request with volume ID 'ef0993c7-a17e-4531-95e7-d09b0bbf13ba'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:16:58.208626 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] Filtering removed all hosts for the request with volume ID 'ef0993c7-a17e-4531-95e7-d09b0bbf13ba'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:16:58.209149 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:16:58.209552 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] Creating message record for request_id = req-5ff39781-de63-4ad5-8c43-f812c10335f8 Sep 03 21:16:58.224153 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:16:58.224644 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] Setting Volume ef0993c7-a17e-4531-95e7-d09b0bbf13ba to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:16:58.240019 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b612292f-857a-4f7d-b615-b4fd345b2cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:16:58.244278 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5ff39781-de63-4ad5-8c43-f812c10335f8 tempest-SnapshotMetadataTestJSON-1176680198 None] Flow 'volume_create_scheduler' (21706f42-2a83-46c2-94b6-83995d5bda11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:02.742465 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] Flow 'volume_create_scheduler' (a1590819-019d-47df-958d-d1251714b6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:02.747520 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5f605511-06f5-42cb-9a27-d6b0f85117c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:02.751889 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5f605511-06f5-42cb-9a27-d6b0f85117c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ff8e161b-75cd-4228-a15b-eae155dddf58),volume_id=ff8e161b-75cd-4228-a15b-eae155dddf58,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:02.755800 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (85402941-a932-4819-b936-f47ad6b728ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:02.765120 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:17:02.779760 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:17:02.780142 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:17:02.780499 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:02.780852 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:02.781934 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:02.782297 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] Filtering removed all hosts for the request with volume ID 'ff8e161b-75cd-4228-a15b-eae155dddf58'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:17:02.782649 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] Filtering removed all hosts for the request with volume ID 'ff8e161b-75cd-4228-a15b-eae155dddf58'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:17:02.783140 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:17:02.783575 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] Creating message record for request_id = req-02c3265f-5d29-4541-9d8e-ebdd4547171a Sep 03 21:17:02.792640 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:17:02.793165 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] Setting Volume ff8e161b-75cd-4228-a15b-eae155dddf58 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:17:02.808623 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (85402941-a932-4819-b936-f47ad6b728ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:02.812164 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-02c3265f-5d29-4541-9d8e-ebdd4547171a tempest-AbsoluteLimitsTests-1940098265 None] Flow 'volume_create_scheduler' (a1590819-019d-47df-958d-d1251714b6c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:07.689307 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] Flow 'volume_create_scheduler' (1dca5b3d-b166-4bd1-b86b-6091ac8108f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:07.693612 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (770ae2c1-68e1-4818-a707-52ea5bb1ae19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:07.698606 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (770ae2c1-68e1-4818-a707-52ea5bb1ae19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(45a2a767-7e21-4d7d-92fc-dbd407d8d873),volume_id=45a2a767-7e21-4d7d-92fc-dbd407d8d873,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:07.702042 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (28f583a3-16fa-4036-82e5-47d54157282d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:07.712457 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:17:07.731204 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:17:07.732118 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:17:07.732497 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:07.732850 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:07.733516 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:07.734238 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] Filtering removed all hosts for the request with volume ID '45a2a767-7e21-4d7d-92fc-dbd407d8d873'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:17:07.734592 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] Filtering removed all hosts for the request with volume ID '45a2a767-7e21-4d7d-92fc-dbd407d8d873'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:17:07.735087 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:17:07.736398 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] Creating message record for request_id = req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef Sep 03 21:17:07.746794 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:17:07.747470 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] Setting Volume 45a2a767-7e21-4d7d-92fc-dbd407d8d873 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:17:07.763687 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (28f583a3-16fa-4036-82e5-47d54157282d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:07.766918 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-6d73d668-c8b2-48f9-b8d0-6ecdf867c4ef tempest-VolumesActionsTest-1183531696 None] Flow 'volume_create_scheduler' (1dca5b3d-b166-4bd1-b86b-6091ac8108f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:11.982899 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] Flow 'volume_create_scheduler' (9cb687d9-e7b1-40fd-8acf-992270be61bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:11.987788 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9e336c44-e10e-4e27-aa85-959562b87650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:11.991859 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9e336c44-e10e-4e27-aa85-959562b87650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a096c81c-4735-4317-a512-2b835e975e2d),volume_id=a096c81c-4735-4317-a512-2b835e975e2d,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:11.995857 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ddd0a252-59a2-4087-8e60-346458a58dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:12.004683 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:17:12.025352 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:17:12.026579 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:17:12.027169 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:12.027685 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:12.028242 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:12.028747 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] Filtering removed all hosts for the request with volume ID 'a096c81c-4735-4317-a512-2b835e975e2d'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:17:12.029330 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] Filtering removed all hosts for the request with volume ID 'a096c81c-4735-4317-a512-2b835e975e2d'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:17:12.029945 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:17:12.030643 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] Creating message record for request_id = req-d69aafd5-fd58-4f83-acdc-b79e13f07909 Sep 03 21:17:12.037652 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:17:12.038114 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] Setting Volume a096c81c-4735-4317-a512-2b835e975e2d to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:17:12.050520 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ddd0a252-59a2-4087-8e60-346458a58dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:12.053789 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d69aafd5-fd58-4f83-acdc-b79e13f07909 tempest-VolumesBackupsTest-165205454 None] Flow 'volume_create_scheduler' (9cb687d9-e7b1-40fd-8acf-992270be61bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:13.489733 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] Flow 'volume_create_scheduler' (3f935da3-7a38-4106-96f2-f6fb2a5155c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:13.493887 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (891f0a6b-39e1-42d3-b915-7f1f1ecaee0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:13.497772 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (891f0a6b-39e1-42d3-b915-7f1f1ecaee0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9d9ea1c8-3e98-474d-a51f-34643aede019),volume_id=9d9ea1c8-3e98-474d-a51f-34643aede019,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:13.501874 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fc3f93a2-8825-48db-8f77-254a10b78e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:13.510071 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:17:13.525114 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:17:13.525481 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:17:13.525834 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:13.526185 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:13.526530 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:13.526878 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] Filtering removed all hosts for the request with volume ID '9d9ea1c8-3e98-474d-a51f-34643aede019'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:17:13.527219 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] Filtering removed all hosts for the request with volume ID '9d9ea1c8-3e98-474d-a51f-34643aede019'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:17:13.527727 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:17:13.528152 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] Creating message record for request_id = req-e272b41b-09ee-4665-9934-257975042595 Sep 03 21:17:13.535381 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:17:13.535730 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] Setting Volume 9d9ea1c8-3e98-474d-a51f-34643aede019 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:17:13.538980 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=74,cinder:UPDATE=15,cinder:INSERT=6,cinder:DELETE=5 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:13.551065 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fc3f93a2-8825-48db-8f77-254a10b78e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:13.554274 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e272b41b-09ee-4665-9934-257975042595 tempest-VolumesBackupsTest-165205454 None] Flow 'volume_create_scheduler' (3f935da3-7a38-4106-96f2-f6fb2a5155c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:17.598300 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] Flow 'volume_create_scheduler' (c797209f-2506-4029-b538-a666eb47bc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:17.603492 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (224063cd-24e0-4c06-a453-1df45a4dd909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:17.608330 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (224063cd-24e0-4c06-a453-1df45a4dd909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a2db41d3-5cda-4c09-a79c-f2fb2fc42a6b),volume_id=a2db41d3-5cda-4c09-a79c-f2fb2fc42a6b,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:17.611996 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2325f1dc-3916-4baf-93e8-271e2c67db82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:17.621330 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:17:17.636294 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:17:17.636655 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:17:17.637042 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:17.637387 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:17.637725 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:17.638068 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] Filtering removed all hosts for the request with volume ID 'a2db41d3-5cda-4c09-a79c-f2fb2fc42a6b'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:17:17.638404 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] Filtering removed all hosts for the request with volume ID 'a2db41d3-5cda-4c09-a79c-f2fb2fc42a6b'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:17:17.638900 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:17:17.639307 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] Creating message record for request_id = req-70226807-2aac-4857-a182-951956c30d46 Sep 03 21:17:17.647592 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:17:17.648143 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] Setting Volume a2db41d3-5cda-4c09-a79c-f2fb2fc42a6b to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:17:17.661931 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2325f1dc-3916-4baf-93e8-271e2c67db82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:17.665962 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-70226807-2aac-4857-a182-951956c30d46 tempest-VolumesCloneTest-649654594 None] Flow 'volume_create_scheduler' (c797209f-2506-4029-b538-a666eb47bc2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:19.032774 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] Flow 'volume_create_scheduler' (3857fb70-f336-4a15-a523-1c97eedd9ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:19.040550 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (10ade925-7bd4-4a7a-9315-b8c6b5884885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:19.050399 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (10ade925-7bd4-4a7a-9315-b8c6b5884885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e89b5dca-976d-488b-acbd-5802e721db3e),volume_id=e89b5dca-976d-488b-acbd-5802e721db3e,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:19.053836 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1cc1cb8a-3ff2-4cd1-977c-741191883e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:19.062964 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:17:19.079601 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:17:19.080203 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:17:19.080706 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:19.081230 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:19.081746 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:19.082253 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] Filtering removed all hosts for the request with volume ID 'e89b5dca-976d-488b-acbd-5802e721db3e'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:17:19.082759 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] Filtering removed all hosts for the request with volume ID 'e89b5dca-976d-488b-acbd-5802e721db3e'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:17:19.083397 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:17:19.084185 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] Creating message record for request_id = req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 Sep 03 21:17:19.092803 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:17:19.093561 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] Setting Volume e89b5dca-976d-488b-acbd-5802e721db3e to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:17:19.107136 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1cc1cb8a-3ff2-4cd1-977c-741191883e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:19.110424 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ff2713a9-b6ad-41fb-b22f-145ba7dbf087 tempest-VolumesCloneTest-649654594 None] Flow 'volume_create_scheduler' (3857fb70-f336-4a15-a523-1c97eedd9ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:27.123185 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] Flow 'volume_create_scheduler' (797f1d4e-d3bc-4f7b-be6b-3953178e9235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:27.128196 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d6de3773-ba96-4d36-b7b4-b8123a077d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:27.134861 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d6de3773-ba96-4d36-b7b4-b8123a077d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9ceeb150-a9cf-4ddc-85dc-13d36950f2a1),volume_id=9ceeb150-a9cf-4ddc-85dc-13d36950f2a1,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:27.138702 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8d898732-e2ee-46b4-949d-0d42890a13ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:27.157190 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:17:27.168578 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:17:27.170163 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:17:27.170729 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:27.172138 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:27.172646 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:27.173177 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] Filtering removed all hosts for the request with volume ID '9ceeb150-a9cf-4ddc-85dc-13d36950f2a1'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:17:27.173664 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] Filtering removed all hosts for the request with volume ID '9ceeb150-a9cf-4ddc-85dc-13d36950f2a1'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:17:27.174309 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:17:27.174966 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] Creating message record for request_id = req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 Sep 03 21:17:27.187581 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:17:27.188203 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] Setting Volume 9ceeb150-a9cf-4ddc-85dc-13d36950f2a1 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:17:27.207660 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8d898732-e2ee-46b4-949d-0d42890a13ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:27.212062 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5afd257c-ecd3-495c-8b2e-2681ee1a27a1 tempest-VolumesSnapshotTestJSON-1629195355 None] Flow 'volume_create_scheduler' (797f1d4e-d3bc-4f7b-be6b-3953178e9235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:37.968145 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-1590db07-dc48-4ca0-96c0-a4c459c03805 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:17:44.151068 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=44,cinder:DELETE=4,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:44.205386 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] Flow 'volume_create_scheduler' (f3fc2e63-6648-457c-b3b9-62ffc349e7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:17:44.216776 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (51a3c61a-1aa0-4ce9-a7c2-39019b64a9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:44.220706 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (51a3c61a-1aa0-4ce9-a7c2-39019b64a9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4a5cc895-c092-4764-82ac-32253a13886c),volume_id=4a5cc895-c092-4764-82ac-32253a13886c,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:44.224114 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c819b58e-0759-4159-97ce-30b51f76f522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:17:44.239888 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:17:44.257139 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:17:44.258495 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:17:44.259034 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:44.259692 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:44.260172 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:17:44.260510 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] Filtering removed all hosts for the request with volume ID '4a5cc895-c092-4764-82ac-32253a13886c'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:17:44.261067 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] Filtering removed all hosts for the request with volume ID '4a5cc895-c092-4764-82ac-32253a13886c'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:17:44.261778 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:17:44.262405 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] Creating message record for request_id = req-f4371be2-fea7-412d-a505-05ffc492939e Sep 03 21:17:44.275812 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:17:44.276496 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] Setting Volume 4a5cc895-c092-4764-82ac-32253a13886c to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:17:44.301705 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c819b58e-0759-4159-97ce-30b51f76f522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:17:44.305716 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [req-7aa232b3-8791-4e4b-8ab2-0beb5061fe05 req-f4371be2-fea7-412d-a505-05ffc492939e tempest-VolumesSnapshotsTestJSON-1878280041 None] Flow 'volume_create_scheduler' (f3fc2e63-6648-457c-b3b9-62ffc349e7da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:18:22.672876 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:18:37.963338 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-5ccf1d19-72d1-4566-b0a8-5a2d41873bda None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:19:02.677764 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:19:32.689168 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:19:37.959305 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-8ed3f842-7169-4da3-946e-329d3630b840 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:19:59.957420 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] Flow 'volume_create_scheduler' (83b4363e-3eaa-46b6-aed7-c0604d208ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:19:59.962107 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (54f05294-cb2b-4216-a570-6bafd011356c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:19:59.966102 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (54f05294-cb2b-4216-a570-6bafd011356c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(d54ddeec-ab45-48cb-ad86-a536fed6b495),volume_id=d54ddeec-ab45-48cb-ad86-a536fed6b495,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:19:59.969509 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (815ab986-2209-4eff-9819-bb4e72119d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:19:59.978559 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:19:59.994357 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:19:59.994782 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:19:59.995211 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:19:59.995473 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:19:59.995912 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:19:59.996324 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] Filtering removed all hosts for the request with volume ID 'd54ddeec-ab45-48cb-ad86-a536fed6b495'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:19:59.996591 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] Filtering removed all hosts for the request with volume ID 'd54ddeec-ab45-48cb-ad86-a536fed6b495'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:19:59.997096 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:19:59.997569 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] Creating message record for request_id = req-b14c20f1-abcc-45f6-b4aa-57a639edb198 Sep 03 21:20:00.009935 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:20:00.010304 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] Setting Volume d54ddeec-ab45-48cb-ad86-a536fed6b495 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:20:00.021127 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (815ab986-2209-4eff-9819-bb4e72119d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:20:00.025939 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b14c20f1-abcc-45f6-b4aa-57a639edb198 tempest-VolumeSnapshotQuotasNegativeTestJSON-1004089610 None] Flow 'volume_create_scheduler' (83b4363e-3eaa-46b6-aed7-c0604d208ecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:20:05.882930 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:20:05.944548 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] Flow 'volume_create_scheduler' (33c423ca-0a34-4629-b1dc-b33289a61c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:20:05.949193 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e41a886d-df66-439d-b19f-96c403e0fdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:20:05.953511 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e41a886d-df66-439d-b19f-96c403e0fdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(d052c083-d274-4fb9-85d8-4fa6a083f404),volume_id=d052c083-d274-4fb9-85d8-4fa6a083f404,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:20:05.962628 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0d498d92-06a5-45ce-8ebc-939bcdea3479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:20:05.974667 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:20:05.993953 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:20:05.995875 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:20:05.997357 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:20:06.000536 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:20:06.001228 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:20:06.002092 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] Filtering removed all hosts for the request with volume ID 'd052c083-d274-4fb9-85d8-4fa6a083f404'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:20:06.002805 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] Filtering removed all hosts for the request with volume ID 'd052c083-d274-4fb9-85d8-4fa6a083f404'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:20:06.003582 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:20:06.005429 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] Creating message record for request_id = req-851c6acf-8283-450d-8ed7-74bfe5ae912a Sep 03 21:20:06.015835 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:20:06.017109 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] Setting Volume d052c083-d274-4fb9-85d8-4fa6a083f404 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:20:06.034955 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0d498d92-06a5-45ce-8ebc-939bcdea3479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:20:06.040294 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-851c6acf-8283-450d-8ed7-74bfe5ae912a tempest-VolumesTransfersTest-1734082900 None] Flow 'volume_create_scheduler' (33c423ca-0a34-4629-b1dc-b33289a61c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:20:07.299186 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] Flow 'volume_create_scheduler' (9faccec2-b6c8-4f52-b7df-f6ea38472fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:20:07.305902 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d65d138c-3ae8-45fd-b0c6-af8d428e2de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:20:07.309860 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d65d138c-3ae8-45fd-b0c6-af8d428e2de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(fb67203b-3e9e-41b6-9143-4d7fd4ff6ad5),volume_id=fb67203b-3e9e-41b6-9143-4d7fd4ff6ad5,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:20:07.313236 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4c528369-12b6-4a76-b516-73cfa344547f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:20:07.323091 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:20:07.339251 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:20:07.339821 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:20:07.341093 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:20:07.341622 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:20:07.342685 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:20:07.343442 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] Filtering removed all hosts for the request with volume ID 'fb67203b-3e9e-41b6-9143-4d7fd4ff6ad5'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:20:07.343954 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] Filtering removed all hosts for the request with volume ID 'fb67203b-3e9e-41b6-9143-4d7fd4ff6ad5'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:20:07.344598 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:20:07.345293 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] Creating message record for request_id = req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 Sep 03 21:20:07.352908 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:20:07.354014 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] Setting Volume fb67203b-3e9e-41b6-9143-4d7fd4ff6ad5 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:20:07.364999 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4c528369-12b6-4a76-b516-73cfa344547f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:20:07.368065 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-5f788c6d-e3e5-439d-bcce-0ebfbd426425 tempest-VolumesTransfersTest-1734082900 None] Flow 'volume_create_scheduler' (9faccec2-b6c8-4f52-b7df-f6ea38472fb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:20:13.300824 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] Flow 'volume_create_scheduler' (05afade1-0cad-4cab-8b27-1012409334f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:20:13.307992 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b7863662-7a0d-4d5a-9537-aded0bdfbf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:20:13.312622 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b7863662-7a0d-4d5a-9537-aded0bdfbf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2b7cf657-5ec1-4fed-83da-ddfe6565eda5),volume_id=2b7cf657-5ec1-4fed-83da-ddfe6565eda5,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:20:13.317664 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (527b133f-cb2f-4bc8-a714-866df3939c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:20:13.340733 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:20:13.354546 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:20:13.355230 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:20:13.355694 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:20:13.356099 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:20:13.356610 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:20:13.357243 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] Filtering removed all hosts for the request with volume ID '2b7cf657-5ec1-4fed-83da-ddfe6565eda5'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:20:13.357602 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] Filtering removed all hosts for the request with volume ID '2b7cf657-5ec1-4fed-83da-ddfe6565eda5'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:20:13.358074 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:20:13.358501 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] Creating message record for request_id = req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d Sep 03 21:20:13.366087 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:20:13.366668 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] Setting Volume 2b7cf657-5ec1-4fed-83da-ddfe6565eda5 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:20:13.378281 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (527b133f-cb2f-4bc8-a714-866df3939c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:20:13.381556 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-58a1fe0c-b632-4ad3-a74d-dd1e71d1359d tempest-VolumesTransfersV355Test-265837233 None] Flow 'volume_create_scheduler' (05afade1-0cad-4cab-8b27-1012409334f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:20:14.807670 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] Flow 'volume_create_scheduler' (99530543-a38b-4b57-8c49-fb09fe586d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:20:14.811772 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (96cddfdc-8d9a-4e8d-b3a3-df01cebe7267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:20:14.816248 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (96cddfdc-8d9a-4e8d-b3a3-df01cebe7267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f7c9d78f-3b2b-42c9-956c-b4274c56c05b),volume_id=f7c9d78f-3b2b-42c9-956c-b4274c56c05b,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:20:14.820288 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b600ad2e-0e73-4a34-836f-92a2c892f95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:20:14.829599 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:20:14.851719 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:20:14.852082 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:20:14.852437 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:20:14.852757 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:20:14.853589 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:20:14.854294 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] Filtering removed all hosts for the request with volume ID 'f7c9d78f-3b2b-42c9-956c-b4274c56c05b'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:20:14.854729 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] Filtering removed all hosts for the request with volume ID 'f7c9d78f-3b2b-42c9-956c-b4274c56c05b'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:20:14.855508 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:20:14.856098 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] Creating message record for request_id = req-4dbdfba2-2794-462b-b0c7-a176aedccfea Sep 03 21:20:14.865576 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:20:14.866296 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] Setting Volume f7c9d78f-3b2b-42c9-956c-b4274c56c05b to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:20:14.883366 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b600ad2e-0e73-4a34-836f-92a2c892f95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:20:14.887248 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-4dbdfba2-2794-462b-b0c7-a176aedccfea tempest-VolumesTransfersV355Test-265837233 None] Flow 'volume_create_scheduler' (99530543-a38b-4b57-8c49-fb09fe586d85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:20:37.963497 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-0fe412af-68c7-4f6b-961f-0fae3e6c6ba8 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:20:42.691792 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=53,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:21:13.927250 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:21:13.932937 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-878ca15f-e448-4a3f-b360-a227154b650a tempest-GroupSnapshotsTest-869091101 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:21:13.939833 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-878ca15f-e448-4a3f-b360-a227154b650a tempest-GroupSnapshotsTest-869091101 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:21:13.940348 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.manager [None req-878ca15f-e448-4a3f-b360-a227154b650a tempest-GroupSnapshotsTest-869091101 None] Could not find a backend for group 2a9b335e-4fd8-4f0d-a644-a4ebcd673d21.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:21:15.349819 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-74232220-936b-442e-b433-1d8dc66ab9ad tempest-GroupSnapshotsTest-869091101 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:21:15.357863 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-74232220-936b-442e-b433-1d8dc66ab9ad tempest-GroupSnapshotsTest-869091101 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:21:15.358506 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.manager [None req-74232220-936b-442e-b433-1d8dc66ab9ad tempest-GroupSnapshotsTest-869091101 None] Could not find a backend for group d7eabf47-d31a-4919-af38-9f97503ac935.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:21:16.793494 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-d7a0db1e-5a51-45bf-be7d-105d9e9795b2 tempest-GroupSnapshotsTest-869091101 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:21:16.801804 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-d7a0db1e-5a51-45bf-be7d-105d9e9795b2 tempest-GroupSnapshotsTest-869091101 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:21:16.802329 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.manager [None req-d7a0db1e-5a51-45bf-be7d-105d9e9795b2 tempest-GroupSnapshotsTest-869091101 None] Could not find a backend for group 118015de-a1fa-40df-b08b-8e5420bde672.: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:21:22.502584 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] Flow 'volume_create_scheduler' (a32f1373-d2e9-4648-bb86-b3fd356e67b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:21:22.506885 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (347d5a42-f902-459d-b2a6-7edd7d802458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:21:22.524038 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (347d5a42-f902-459d-b2a6-7edd7d802458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5471a0b2-8d2f-4169-977d-c360809d40a8),volume_id=5471a0b2-8d2f-4169-977d-c360809d40a8,volume_properties=VolumeProperties,volume_type=VolumeType(506879e0-d4a4-483d-ad42-c7d205edd690))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:21:22.550372 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c0b47293-2fe2-46bd-86b1-3b317c238a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:21:22.558552 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:21:22.572762 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:21:22.573166 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:21:22.573523 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:21:22.573877 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:21:22.574223 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:21:22.574571 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] Filtering removed all hosts for the request with volume ID '5471a0b2-8d2f-4169-977d-c360809d40a8'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:21:22.574916 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] Filtering removed all hosts for the request with volume ID '5471a0b2-8d2f-4169-977d-c360809d40a8'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:21:22.575402 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] No weighed backend found for volume with properties: {'id': '506879e0-d4a4-483d-ad42-c7d205edd690', 'name': 'tempest-VolumeTypesAccessTest-volume-type-1143431749', 'description': None, 'is_public': False, 'projects': [], 'extra_specs': {}, 'qos_specs_id': None, 'created_at': '2022-09-03T21:21:22.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:21:22.576052 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] Creating message record for request_id = req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 Sep 03 21:21:22.585857 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:21:22.586594 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] Setting Volume 5471a0b2-8d2f-4169-977d-c360809d40a8 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:21:22.602157 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c0b47293-2fe2-46bd-86b1-3b317c238a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:21:22.606363 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-7dbd04e0-7c4b-4550-bc5d-343c06b91a96 tempest-VolumeTypesAccessTest-916561705 None] Flow 'volume_create_scheduler' (a32f1373-d2e9-4648-bb86-b3fd356e67b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:21:29.795448 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] Flow 'volume_create_scheduler' (c64eebfd-ebb4-4c6a-aeed-fc01191f4d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:21:29.799705 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ac569b57-592e-437f-8537-9c301cf7121c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:21:29.803779 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ac569b57-592e-437f-8537-9c301cf7121c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ab7bb0d4-5647-49d5-afcc-cc620786708d),volume_id=ab7bb0d4-5647-49d5-afcc-cc620786708d,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:21:29.807157 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (adf16903-79e8-40d0-8776-7f52f2979d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:21:29.815285 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:21:29.828714 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:21:29.829098 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:21:29.829454 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:21:29.829801 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:21:29.830143 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:21:29.830491 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] Filtering removed all hosts for the request with volume ID 'ab7bb0d4-5647-49d5-afcc-cc620786708d'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:21:29.830833 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] Filtering removed all hosts for the request with volume ID 'ab7bb0d4-5647-49d5-afcc-cc620786708d'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:21:29.831809 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:21:29.832233 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] Creating message record for request_id = req-b56d6450-4a18-47ed-acb9-ae1f268115d3 Sep 03 21:21:29.839010 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:21:29.839389 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] Setting Volume ab7bb0d4-5647-49d5-afcc-cc620786708d to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:21:29.850750 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (adf16903-79e8-40d0-8776-7f52f2979d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:21:29.853900 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b56d6450-4a18-47ed-acb9-ae1f268115d3 tempest-VolumesDeleteCascade-486123341 None] Flow 'volume_create_scheduler' (c64eebfd-ebb4-4c6a-aeed-fc01191f4d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:21:32.836844 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] Flow 'volume_create_scheduler' (7a245366-f275-4178-ab29-d20f07bf3b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:21:32.841368 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (dff66c3c-514a-4f60-9804-8dba6f93d087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:21:32.845201 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (dff66c3c-514a-4f60-9804-8dba6f93d087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(51b22267-439d-4bd0-ad61-c1b70eec85a4),volume_id=51b22267-439d-4bd0-ad61-c1b70eec85a4,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:21:32.848550 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bf040f64-ddc9-4384-99b3-6e46ec6fa807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:21:32.856305 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:21:32.870422 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:21:32.870785 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:21:32.871140 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:21:32.871486 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:21:32.871827 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:21:32.872174 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] Filtering removed all hosts for the request with volume ID '51b22267-439d-4bd0-ad61-c1b70eec85a4'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:21:32.872514 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] Filtering removed all hosts for the request with volume ID '51b22267-439d-4bd0-ad61-c1b70eec85a4'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:21:32.873041 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:21:32.873467 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] Creating message record for request_id = req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d Sep 03 21:21:32.880260 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:21:32.880671 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] Setting Volume 51b22267-439d-4bd0-ad61-c1b70eec85a4 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:21:32.890586 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bf040f64-ddc9-4384-99b3-6e46ec6fa807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:21:32.893731 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d209b9ae-2d1c-4d82-ad2c-a80a8b0ec08d tempest-VolumesMetadataTest-363735730 None] Flow 'volume_create_scheduler' (7a245366-f275-4178-ab29-d20f07bf3b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:21:35.811765 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] Flow 'volume_create_scheduler' (d862f03a-6a43-476f-a9fd-57d3826b7140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:21:35.816423 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fab34c22-0ab4-4b5b-a9e9-2bbf1abe939e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:21:35.820264 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fab34c22-0ab4-4b5b-a9e9-2bbf1abe939e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(00a87dc7-8bef-4b22-952e-2f095f293258),volume_id=00a87dc7-8bef-4b22-952e-2f095f293258,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:21:35.831649 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (137ca06c-0e9f-4b37-a934-01fe3e29c2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:21:35.840926 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:21:35.856511 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:21:35.857348 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:21:35.858147 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:21:35.858491 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:21:35.858833 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:21:35.859179 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] Filtering removed all hosts for the request with volume ID '00a87dc7-8bef-4b22-952e-2f095f293258'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:21:35.859518 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] Filtering removed all hosts for the request with volume ID '00a87dc7-8bef-4b22-952e-2f095f293258'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:21:35.859997 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:21:35.860415 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] Creating message record for request_id = req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 Sep 03 21:21:35.868034 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:21:35.869072 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] Setting Volume 00a87dc7-8bef-4b22-952e-2f095f293258 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:21:35.883588 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (137ca06c-0e9f-4b37-a934-01fe3e29c2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:21:35.886672 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-d5be1d15-fa4c-435b-b50f-d7412203b0a9 tempest-VolumesBackupsV39Test-902041677 None] Flow 'volume_create_scheduler' (d862f03a-6a43-476f-a9fd-57d3826b7140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:21:37.967840 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-88affe60-b60d-433a-8f8f-bbeab862d363 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:21:39.191910 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] Flow 'volume_create_scheduler' (79804069-1aa8-449a-8e19-c78e46927ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:21:39.197449 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a2329ebe-07e5-4fae-b62b-86260c44c3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:21:39.199938 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a2329ebe-07e5-4fae-b62b-86260c44c3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f3f4ca17-7558-42b0-8e78-c281db2f52b2),volume_id=f3f4ca17-7558-42b0-8e78-c281db2f52b2,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:21:39.203375 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a9e73c18-9c5c-4240-837a-2ab2f050670d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:21:39.211793 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:21:39.226935 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:21:39.227411 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:21:39.227852 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:21:39.228291 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:21:39.228858 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:21:39.229518 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] Filtering removed all hosts for the request with volume ID 'f3f4ca17-7558-42b0-8e78-c281db2f52b2'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:21:39.229786 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] Filtering removed all hosts for the request with volume ID 'f3f4ca17-7558-42b0-8e78-c281db2f52b2'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:21:39.230406 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:21:39.230928 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] Creating message record for request_id = req-b20be011-030f-4dea-b339-3e162d1b6356 Sep 03 21:21:39.243676 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:21:39.244051 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] Setting Volume f3f4ca17-7558-42b0-8e78-c281db2f52b2 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:21:39.255364 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a9e73c18-9c5c-4240-837a-2ab2f050670d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:21:39.258489 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-b20be011-030f-4dea-b339-3e162d1b6356 tempest-VolumesSnapshotListTestJSON-2058458312 None] Flow 'volume_create_scheduler' (79804069-1aa8-449a-8e19-c78e46927ac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:21:39.261682 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=75,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=5 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:22:12.703943 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:22:37.961710 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-459b1487-c5db-40bf-a6d1-08e33e642a6f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:22:42.716965 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:23:12.726574 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:23:37.958399 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-94445c6b-9476-4787-9b75-d1a9d75e98cd None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:23:42.734372 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:24:22.740129 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:24:37.954315 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-caa3213f-af63-4aa0-b1b0-50005b166de9 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:24:52.751314 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:25:22.762679 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:25:37.959139 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-f820c01b-bfb7-4342-9685-27e3185b7606 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:25:52.776541 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:26:22.785500 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:26:37.963650 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-371a7d05-14c5-44ef-88c5-fb4f0828bcdf None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:26:52.797598 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:20.221844 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] Flow 'volume_create_scheduler' (37b35215-79e1-48c2-8a5e-46bfd7c53257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:27:20.226545 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e69b9c71-3c0a-4694-902a-6a49d5c9e1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:27:20.231640 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e69b9c71-3c0a-4694-902a-6a49d5c9e1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5959598e-36b5-4a0a-a2bb-35f8bb693253),volume_id=5959598e-36b5-4a0a-a2bb-35f8bb693253,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:27:20.235817 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9c9f0440-b18f-45b3-878c-de3e34aaf99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:27:20.244485 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:27:20.261524 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:27:20.261747 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:27:20.262285 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:27:20.263306 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:27:20.263665 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:27:20.264020 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] Filtering removed all hosts for the request with volume ID '5959598e-36b5-4a0a-a2bb-35f8bb693253'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:27:20.264386 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] Filtering removed all hosts for the request with volume ID '5959598e-36b5-4a0a-a2bb-35f8bb693253'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:27:20.265103 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:27:20.265538 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] Creating message record for request_id = req-baa68404-9179-4f64-b0b4-74b2b74444c2 Sep 03 21:27:20.278302 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:27:20.278809 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] Setting Volume 5959598e-36b5-4a0a-a2bb-35f8bb693253 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:27:20.291159 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9c9f0440-b18f-45b3-878c-de3e34aaf99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:27:20.294541 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-baa68404-9179-4f64-b0b4-74b2b74444c2 tempest-TestVolumeBackupRestore-1582466673 None] Flow 'volume_create_scheduler' (37b35215-79e1-48c2-8a5e-46bfd7c53257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:27:32.796142 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:37.968798 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-6e431180-dd59-43e4-ac7a-70db790a9069 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:28:12.806231 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:37.974724 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-8c749c1d-2c35-48d4-b673-415384423ebf None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:28:42.818020 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:12.829887 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:37.970826 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-9e0b3334-de33-448b-abac-b1aec43b5646 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:29:42.840221 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:30:12.850095 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:30:37.976338 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-dc981e1c-2cd1-4bdf-851b-9bfc2b855f69 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:30:42.866462 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:31:22.868996 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:31:37.981099 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-4c7df7cf-e2f2-46a7-96a1-5fd36d212d4e None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:31:52.879024 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:22.888186 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:37.987233 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-f350a1e9-7203-44d7-863d-8f4f70eeeb1d None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:32:52.899470 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:33:22.910167 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:33:37.992036 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-683cee28-9966-4920-8fc9-66c62c718d6c None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:33:52.920025 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:34:22.929968 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:34:37.996595 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-b28523fc-21fc-4155-9508-f10b9a6aafae None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:34:52.939195 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:35:22.947198 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:35:38.002076 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-2c9b8b14-f025-4a69-b604-ee7e8c75748f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:36:02.952351 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:36:32.963312 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:36:38.006951 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-5a08b681-5be7-43f5-926b-ab3449161eea None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:36:56.552767 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] Flow 'volume_create_scheduler' (50a74fca-24db-46c7-80fd-ddc335011a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:36:56.556811 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5daefd63-6525-4590-b20c-552a0624df51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:36:56.560619 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5daefd63-6525-4590-b20c-552a0624df51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(10ec2c3a-b30e-4ae9-9c18-313472bf2ca2),volume_id=10ec2c3a-b30e-4ae9-9c18-313472bf2ca2,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:36:56.563996 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cec6b15a-a9e7-4626-a31d-9c3a30c214cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:36:56.572166 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:36:56.585865 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:36:56.586226 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:36:56.586574 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:36:56.586917 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:36:56.587253 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:36:56.587592 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] Filtering removed all hosts for the request with volume ID '10ec2c3a-b30e-4ae9-9c18-313472bf2ca2'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:36:56.587925 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] Filtering removed all hosts for the request with volume ID '10ec2c3a-b30e-4ae9-9c18-313472bf2ca2'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:36:56.588397 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:36:56.588814 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] Creating message record for request_id = req-ceb00c96-2431-4eed-892e-e7672d5b7d79 Sep 03 21:36:56.595846 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:36:56.596251 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] Setting Volume 10ec2c3a-b30e-4ae9-9c18-313472bf2ca2 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:36:56.605438 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (cec6b15a-a9e7-4626-a31d-9c3a30c214cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:36:56.608534 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-ceb00c96-2431-4eed-892e-e7672d5b7d79 tempest-ServerActionsTestJSON-857509781 None] Flow 'volume_create_scheduler' (50a74fca-24db-46c7-80fd-ddc335011a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:37:02.978249 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:38.012274 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-f12935db-437c-4896-bb7d-69b42945489d None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:37:42.986040 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:22.988156 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:38.017293 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-80106da0-b9ab-45aa-b4c0-ae54d61808e8 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:38:40.264291 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] Flow 'volume_create_scheduler' (b2ee1924-e884-4f4a-83c1-7bcb9e02c35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:38:40.268383 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6e66308f-c41a-4482-89ff-6ea6d1e95fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:38:40.272178 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6e66308f-c41a-4482-89ff-6ea6d1e95fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ec302325-8c64-4454-b81b-7f4d19324ae3),volume_id=ec302325-8c64-4454-b81b-7f4d19324ae3,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:38:40.275524 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8a3ce4d4-5f1a-4a05-a912-d1b8e124c218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:38:40.284159 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:38:40.298105 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:38:40.298466 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:38:40.298818 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:38:40.299720 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:38:40.300062 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:38:40.300418 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] Filtering removed all hosts for the request with volume ID 'ec302325-8c64-4454-b81b-7f4d19324ae3'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:38:40.300752 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] Filtering removed all hosts for the request with volume ID 'ec302325-8c64-4454-b81b-7f4d19324ae3'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:38:40.301257 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:38:40.301659 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] Creating message record for request_id = req-dfcab29f-3d0e-4003-8821-f6241445f801 Sep 03 21:38:40.308009 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:38:40.308589 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] Setting Volume ec302325-8c64-4454-b81b-7f4d19324ae3 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:38:40.318097 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8a3ce4d4-5f1a-4a05-a912-d1b8e124c218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:38:40.321197 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-dfcab29f-3d0e-4003-8821-f6241445f801 tempest-TestMinimumBasicScenario-746967112 None] Flow 'volume_create_scheduler' (b2ee1924-e884-4f4a-83c1-7bcb9e02c35e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:38:53.003599 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=22,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:12.170930 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] Flow 'volume_create_scheduler' (bc6df581-661e-4ccd-95d4-b798f4866d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:39:12.175435 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fde7cd0a-2d64-4bb2-aaf3-07bec63a4a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:39:12.179232 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fde7cd0a-2d64-4bb2-aaf3-07bec63a4a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(6f185df7-822a-44cb-8b70-4001933dd681),volume_id=6f185df7-822a-44cb-8b70-4001933dd681,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:39:12.182577 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (66669770-4aa7-4902-80bf-1a3ba2a62d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:39:12.190773 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:39:12.204479 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:39:12.204850 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:39:12.205233 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:39:12.205581 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:39:12.205934 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:39:12.206767 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] Filtering removed all hosts for the request with volume ID '6f185df7-822a-44cb-8b70-4001933dd681'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:39:12.207126 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] Filtering removed all hosts for the request with volume ID '6f185df7-822a-44cb-8b70-4001933dd681'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:39:12.207604 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:39:12.208038 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] Creating message record for request_id = req-e582adac-93ca-4d05-b4c7-c7118c40b32e Sep 03 21:39:12.214909 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:39:12.215221 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] Setting Volume 6f185df7-822a-44cb-8b70-4001933dd681 to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:39:12.225703 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (66669770-4aa7-4902-80bf-1a3ba2a62d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:39:12.228791 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-e582adac-93ca-4d05-b4c7-c7118c40b32e tempest-TestMinimumBasicScenario-746967112 None] Flow 'volume_create_scheduler' (bc6df581-661e-4ccd-95d4-b798f4866d2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:39:33.008422 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=6,cinder:SELECT=21,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:38.022920 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-a3e3082b-833e-49ca-9bf5-b1d501bc1498 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:40:13.019419 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:40:43.030466 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:13.042364 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:38.029814 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-4c31b483-ffdd-4335-9a7e-56e04503420f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:41:43.051852 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:42:13.060835 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:42:38.034677 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-8a4645cf-d0c8-4660-bc74-3076142c6e07 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:42:43.075620 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:43:13.084838 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:43:38.039822 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-a5c4e5f2-e7b6-44e8-8a9a-175f04f378ca None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:43:43.094149 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:44:13.106396 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:44:38.044585 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-bcddb9d8-bb34-4c38-98c3-94b88d55a4c6 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:44:43.118392 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:45:23.123602 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:45:38.050232 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-84489a94-92cc-4a30-8bdc-fafb64bd993c None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:45:53.134900 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:46:33.139955 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:46:38.046220 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-1625e703-9374-45fe-9102-4b79b0ac1e58 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:47:13.144293 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:47:38.051074 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-2053ebbf-ebee-4863-b327-03a28f95aefc None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:47:43.158144 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:48:13.171681 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:48:38.056232 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-b203c6c1-3535-4235-85d5-452c95784a07 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:48:53.174549 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:49:23.186421 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:49:38.062251 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-db04a95b-5bc3-460e-94a7-3c9a43f9de05 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:50:03.191846 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:50:33.204711 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:50:38.068063 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-4892c0e9-9655-4dc3-a552-187de7209d7b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:51:03.212447 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:51:33.219494 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:51:38.072726 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-191c8c5b-f449-4ecc-8f5a-f4e55cda1d63 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:52:03.228352 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:52:38.078065 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-4d2eaeac-6c14-46b2-bc04-006ef3d9c59a None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:52:43.230585 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:53:13.238008 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:53:38.083999 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-6a9a983e-f47e-4b24-a84b-d61e60fdc140 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:53:43.246274 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:53:59.195570 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] Flow 'volume_create_scheduler' (6e6951e6-4a2e-48b8-99d4-9ed7cb8e8dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:53:59.199672 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a23359e0-4ab9-4f9a-b962-1503e230931b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:53:59.203511 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a23359e0-4ab9-4f9a-b962-1503e230931b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=bb6b1dcc-96d7-4d20-8933-997caa341790,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e0f3ce5d-cadb-4b5d-8adf-6e2e3eab40ca),volume_id=e0f3ce5d-cadb-4b5d-8adf-6e2e3eab40ca,volume_properties=VolumeProperties,volume_type=VolumeType(d5f67b46-da42-4da6-ba4d-62966baf81fc))}' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:53:59.207540 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (207885d5-3d0f-4724-8a60-b8b41986ff3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Sep 03 21:53:59.215724 ncdv-master-1 cinder-scheduler[132453]: DEBUG oslo_db.sqlalchemy.engines [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:53:59.229243 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.host_manager [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] volume service is down. (host: ncdv-master-1@ceph) Sep 03 21:53:59.229640 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] Starting with 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Sep 03 21:53:59.229958 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] Filter AvailabilityZoneFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:53:59.230330 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] Filter CapacityFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:53:59.230729 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=132453) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Sep 03 21:53:59.231006 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.base_filter [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] Filtering removed all hosts for the request with volume ID 'e0f3ce5d-cadb-4b5d-8adf-6e2e3eab40ca'. Filter results: [('AvailabilityZoneFilter', []), ('CapacityFilter', []), ('CapabilitiesFilter', [])] {{(pid=132453) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Sep 03 21:53:59.231346 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.scheduler.base_filter [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] Filtering removed all hosts for the request with volume ID 'e0f3ce5d-cadb-4b5d-8adf-6e2e3eab40ca'. Filter results: AvailabilityZoneFilter: (start: 0, end: 0), CapacityFilter: (start: 0, end: 0), CapabilitiesFilter: (start: 0, end: 0) Sep 03 21:53:59.231824 ncdv-master-1 cinder-scheduler[132453]: WARNING cinder.scheduler.filter_scheduler [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] No weighed backend found for volume with properties: {'id': 'd5f67b46-da42-4da6-ba4d-62966baf81fc', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-09-03T20:39:42.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Sep 03 21:53:59.232244 ncdv-master-1 cinder-scheduler[132453]: INFO cinder.message.api [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] Creating message record for request_id = req-0299e95c-048f-4212-91f0-42599d59a8fc Sep 03 21:53:59.238519 ncdv-master-1 cinder-scheduler[132453]: ERROR cinder.scheduler.flows.create_volume [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Sep 03 21:53:59.238933 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.volume.flows.common [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] Setting Volume e0f3ce5d-cadb-4b5d-8adf-6e2e3eab40ca to error due to: No valid backend was found. No weighed backends available {{(pid=132453) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Sep 03 21:53:59.249011 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (207885d5-3d0f-4724-8a60-b8b41986ff3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=132453) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Sep 03 21:53:59.252085 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.manager [None req-0299e95c-048f-4212-91f0-42599d59a8fc tempest-TestShelveInstance-940777711 None] Flow 'volume_create_scheduler' (6e6951e6-4a2e-48b8-99d4-9ed7cb8e8dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=132453) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Sep 03 21:54:13.257661 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=22,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:54:38.088701 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-d0874f05-068e-40f1-97ed-b32b9b7136ec None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:54:53.265269 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:55:23.274382 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:55:38.093540 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-10cbfff9-14b9-48c8-8341-3e419a624cad None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:55:53.284422 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:56:23.298106 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:56:38.100692 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-4e1780c9-bb78-4b07-b567-eef3d14a0e79 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:56:53.306385 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:57:33.307261 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:57:38.107181 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-8020ee6f-f96d-423e-a778-a0c7c3687ffc None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:58:03.315268 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:58:33.322992 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:58:38.107538 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-f20e9af7-636c-4954-a821-1a2aa147db0c None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:59:03.334591 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:59:38.098853 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-dd934b55-bf10-449f-bda1-c52575cf1b61 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 21:59:43.336165 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:00:13.347307 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:00:38.104297 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-96dadbfa-d5f7-4dfd-80b0-a8dffcb4fd96 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 22:00:43.362654 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:01:13.372790 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:01:38.111590 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-4addc187-88d3-4e1a-b134-a74f48fdff79 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 22:01:43.381140 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:02:13.390353 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:02:38.109476 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-9d38997f-7f85-4f5a-b72c-b4d4eb1fb110 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 22:02:43.397485 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:03:13.407182 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:03:38.114858 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-9f149f3c-9e9e-46c2-9731-bd8d7c4f030b None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 22:03:43.417467 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:04:13.424883 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:04:38.119664 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-d8f902ce-516a-491c-9842-0e4f4dcf031f None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 22:04:43.433230 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:05:13.440519 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:05:38.124235 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-e438a616-6c63-4285-af54-006761448ae6 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 22:05:43.448265 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:06:13.456802 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:06:38.120701 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-ca6a6fdf-082c-427c-8a2a-232c900dd346 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}} Sep 03 22:06:53.457775 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:07:23.466936 ncdv-master-1 cinder-scheduler[132453]: DEBUG dbcounter [-] [132453] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=132453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 22:07:38.120128 ncdv-master-1 cinder-scheduler[132453]: DEBUG cinder.scheduler.host_manager [None req-74892f7a-cccf-44d2-88ea-363b3d068a08 None None] Received backup service update from ncdv-master-1: {'backend_state': True, 'driver_name': 'cinder.backup.drivers.ceph.CephBackupDriver', 'availability_zone': 'nova'} {{(pid=132453) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:597}}