-- Logs begin at Sat 2022-10-29 20:01:15 UTC, end at Sat 2022-10-29 22:25:27 UTC. --
Oct 29 20:37:16.461814 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service.
Oct 29 20:37:19.734416 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=131610) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}}
Oct 29 20:37:19.735258 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=131610) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}}
Oct 29 20:37:19.735258 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=131610) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}}
Oct 29 20:37:20.151986 ncdv-master-1 cinder-volume[131610]: INFO dbcounter [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Registered counter for database cinder
Oct 29 20:37:20.171360 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_db.sqlalchemy.engines [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}}
Oct 29 20:37:20.178028 ncdv-master-1 cinder-volume[131610]: DEBUG dbcounter [-] [131610] Writer thread running {{(pid=131610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Oct 29 20:37:20.465560 ncdv-master-1 cinder-volume[131610]: INFO cinder.rpc [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Oct 29 20:37:20.470630 ncdv-master-1 cinder-volume[131610]: INFO cinder.rpc [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Oct 29 20:37:20.477935 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_db.sqlalchemy.engines [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}}
Oct 29 20:37:20.545938 ncdv-master-1 cinder-volume[131610]: INFO cinder.volume.manager [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Determined volume DB was empty at startup.
Oct 29 20:37:20.546559 ncdv-master-1 cinder-volume[131610]: DEBUG cinder.volume.manager [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=131610) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}}
Oct 29 20:37:20.555240 ncdv-master-1 cinder-volume[131610]: INFO cinder.volume.manager [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Service not found for updating active_backend_id, assuming default for driver init.
Oct 29 20:37:20.556017 ncdv-master-1 cinder-volume[131610]: WARNING stevedore.named [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Oct 29 20:37:20.556485 ncdv-master-1 cinder-volume[131610]: WARNING castellan.key_manager [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Oct 29 20:37:20.557646 ncdv-master-1 cinder-volume[131610]: WARNING cinder.keymgr.conf_key_mgr [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Oct 29 20:37:20.575734 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_db.sqlalchemy.engines [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}}
Oct 29 20:37:20.580530 ncdv-master-1 cinder-volume[131610]: INFO cinder.rpc [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Oct 29 20:37:20.585359 ncdv-master-1 cinder-volume[131610]: INFO cinder.rpc [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version.
Oct 29 20:37:20.586148 ncdv-master-1 cinder-volume[131610]: WARNING stevedore.named [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Oct 29 20:37:20.586574 ncdv-master-1 cinder-volume[131610]: WARNING castellan.key_manager [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Oct 29 20:37:20.588347 ncdv-master-1 cinder-volume[131610]: INFO cinder.volume.manager [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Image-volume cache enabled for host ncdv-master-1@ceph.
Oct 29 20:37:20.596325 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_db.sqlalchemy.engines [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}}
Oct 29 20:37:20.618017 ncdv-master-1 cinder-volume[131610]: INFO oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Starting 1 workers
Oct 29 20:37:20.630583 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Started child 131780 {{(pid=131610) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}}
Oct 29 20:37:20.631286 ncdv-master-1 cinder-volume[131780]: INFO cinder.service [-] Starting cinder-volume node (version 21.1.0)
Oct 29 20:37:20.631812 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Full set of CONF: {{(pid=131610) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}}
Oct 29 20:37:20.631948 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ******************************************************************************** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Oct 29 20:37:20.632234 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] Configuration options gathered from: {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Oct 29 20:37:20.632879 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Oct 29 20:37:20.634009 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Oct 29 20:37:20.634635 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ================================================================================ {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Oct 29 20:37:20.635549 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] allow_availability_zone_fallback = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.636131 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] allow_compression_on_image_upload = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.636851 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] allowed_direct_url_schemes     = [] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.637425 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] api_rate_limit                 = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.638046 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] auth_strategy                  = keystone {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.638653 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] az_cache_duration              = 3600 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.639197 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_availability_zone      = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.639763 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_host                   = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.640286 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_name                   = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.640870 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_stats_polling_interval = 60 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.641260 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backup_api_class               = cinder.backup.api.API {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.641701 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.642442 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backup_name_template           = backup-%s {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.643021 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backup_use_same_host           = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.643557 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backup_use_temp_snapshot       = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.644101 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] chap_password                  = **** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.644624 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] chap_username                  =  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.646016 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.646632 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cinder_internal_tenant_project_id = c86e80b1bf7a40cda83640c69ce1e1c4 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.647020 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cinder_internal_tenant_user_id = 03a33ff7b2cd490588c2190325ae460f {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.647574 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cloned_volume_same_az          = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.648102 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cluster                        = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.648632 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] compression_format             = gzip {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.649225 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] compute_api_class              = cinder.compute.nova.API {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.649703 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] config_dir                     = [] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.650179 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.650727 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] config_source                  = [] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.651262 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.651850 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] control_exchange               = openstack {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.652436 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] debug                          = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.653062 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] default_availability_zone      = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.653620 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] default_group_type             = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.654440 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.655232 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] default_volume_type            = ceph {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.655848 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] driver_client_cert             = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.656368 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] driver_client_cert_key         = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.656878 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] driver_data_namespace          = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.657399 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] driver_ssl_cert_path           = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.658062 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] driver_ssl_cert_verify         = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.658590 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] driver_use_ssl                 = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.659220 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] enable_force_upload            = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.660501 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] enable_new_services            = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.661031 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] enable_unsupported_driver      = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.661628 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] enabled_backends               = ['ceph'] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.662172 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] enforce_multipath_for_image_xfer = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.662691 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] filter_function                = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.663461 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] glance_api_insecure            = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.664160 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] glance_api_servers             = ['http://10.222.0.36/image'] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.664672 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] glance_api_ssl_compression     = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.665195 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] glance_ca_certificates_file    = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.665764 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] glance_catalog_info            = image:glance:publicURL {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.666130 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] glance_certfile                = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.666642 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.667023 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] glance_keyfile                 = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.667202 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] Starting volume driver RBDDriver (1.3.0)
Oct 29 20:37:20.667424 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] glance_num_retries             = 3 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.667787 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] glance_request_timeout         = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.668139 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] goodness_function              = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.668518 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] graceful_shutdown_timeout      = 5 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.668888 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] group_api_class                = cinder.group.api.API {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.669199 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] host                           = ncdv-master-1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.670322 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] iet_conf                       = /etc/iet/ietd.conf {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.670554 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] image_compress_on_upload       = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.670928 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] image_conversion_address_space_limit = 1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.671310 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] image_conversion_cpu_limit     = 60 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.671789 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:37:20.671885 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.672195 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] image_conversion_disable       = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.672576 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] image_upload_use_cinder_backend = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.672951 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] image_upload_use_internal_tenant = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.673306 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] image_volume_cache_enabled     = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.673686 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] image_volume_cache_max_count   = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.674059 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] image_volume_cache_max_size_gb = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.674439 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] init_host_max_objects_retrieval = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.674828 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] instance_format                = [instance: %(uuid)s]  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.675228 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.675625 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] iscsi_iotype                   = fileio {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.676025 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] iscsi_secondary_ip_addresses   = [] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.676414 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] iscsi_target_flags             =  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.676781 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] iscsi_write_cache              = on {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.677146 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] iser_helper                    = tgtadm {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.677766 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] iser_ip_address                = 10.222.0.36 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.678218 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] iser_port                      = 3260 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.678586 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.678971 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] log_config_append              = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.679381 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.679738 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] log_dir                        = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.680847 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] log_file                       = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.680847 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] log_options                    = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.680847 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] log_rotate_interval            = 1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.681252 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] log_rotate_interval_type       = days {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.681649 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] log_rotation_type              = none {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.681977 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.682279 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.682657 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.683049 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.683508 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.683920 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] max_age                        = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.684279 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] max_logfile_count              = 30 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.684640 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] max_logfile_size_mb            = 200 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.685034 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] max_over_subscription_ratio    = 20.0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.686393 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] message_reap_interval          = 86400 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.686909 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] message_ttl                    = 2592000 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.687502 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] migration_create_volume_timeout_secs = 300 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.687991 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] monkey_patch                   = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.688520 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] monkey_patch_modules           = [] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.688829 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] my_ip                          = 10.222.0.36 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.689209 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] no_snapshot_gb_quota           = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.689594 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] num_iser_scan_tries            = 3 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.690008 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] num_shell_tries                = 3 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.690398 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] num_volume_device_scan_tries   = 3 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.690755 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] nvmet_ns_id                    = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.691138 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] nvmet_port_id                  = 1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.691514 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] osapi_max_limit                = 1000 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.691882 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] osapi_volume_ext_list          = [] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.692693 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.692693 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.693044 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] osapi_volume_listen_port       = 8776 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.693406 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] osapi_volume_use_ssl           = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.693805 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] osapi_volume_workers           = 2 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.694184 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] per_volume_size_limit          = -1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.694513 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] periodic_fuzzy_delay           = 60 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.694888 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] periodic_interval              = 60 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.695304 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.695670 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] public_endpoint                = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.696041 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] publish_errors                 = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.696423 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] quota_backup_gigabytes         = 1000 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.696812 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] quota_backups                  = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.697179 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] quota_consistencygroups        = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.697607 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.697970 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] quota_gigabytes                = 1000 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.698319 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] quota_groups                   = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.698697 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] quota_snapshots                = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.699058 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] quota_volumes                  = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.699432 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] rate_limit_burst               = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.699814 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] rate_limit_except_level        = CRITICAL {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.700340 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] rate_limit_interval            = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.700898 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] reinit_driver_count            = 3 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.701422 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] replication_device             = **** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.701935 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] report_discard_supported       = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.702444 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] report_interval                = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.703072 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] reservation_clean_interval     = 86400 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.703505 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] reservation_expire             = 86400 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.704001 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] reserved_percentage            = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.704524 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.705036 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.705621 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] rpc_response_timeout           = 120 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.706144 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] run_external_periodic_tasks    = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.706649 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.707153 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] scst_target_driver             = iscsi {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.707657 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] scst_target_iqn_name           = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.708106 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] service_down_time              = 60 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.708637 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] snapshot_name_template         = snapshot-%s {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.709147 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] snapshot_same_host             = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.709696 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] split_loggers                  = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.710139 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] state_path                     = /opt/stack/data/cinder {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.710637 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] storage_availability_zone      = nova {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.711156 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] storage_protocol               = iSCSI {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.711683 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] syslog_log_facility            = LOG_USER {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.712229 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] target_helper                  = lioadm {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.712841 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] target_ip_address              = 10.222.0.36 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.713355 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] target_port                    = 3260 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.713897 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.714449 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] target_protocol                = iscsi {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.714948 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] trace_flags                    = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.715455 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.715996 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] transport_url                  = **** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.716542 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] until_refresh                  = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.717049 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] use_chap_auth                  = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.717590 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] use_default_quota_class        = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.718089 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] use_eventlog                   = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.718599 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] use_journal                    = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.719108 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] use_json                       = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.719613 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] use_multipath_for_image_xfer   = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.720104 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] use_stderr                     = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.720592 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] use_syslog                     = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.721126 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] verify_glance_signatures       = enabled {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.721647 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] volume_api_class               = cinder.volume.api.API {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.722149 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] volume_backend_name            = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.722686 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] volume_clear                   = zero {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.723190 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] volume_clear_ionice            = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.723724 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] volume_clear_size              = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.724424 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.724962 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] volume_copy_bps_limit          = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.725543 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] volume_dd_blocksize            = 1M {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.726061 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.726594 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] volume_name_template           = volume-%s {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.726978 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] volume_service_inithost_offload = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.727350 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] volume_usage_audit_period      = month {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.727824 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.728175 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] watch_log_file                 = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.728550 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] zoning_mode                    = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Oct 29 20:37:20.729045 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.729594 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.729928 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.730345 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_concurrency.disable_process_locking = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.730898 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.731320 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.731676 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.732588 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.732959 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.733320 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.736042 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.admin_password = **** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.736620 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.736957 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.admin_token = **** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.737325 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.admin_user  = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.737773 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.738152 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.738539 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.auth_port   = 35357 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.738942 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.auth_protocol = https {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.739370 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.auth_section = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.739756 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.auth_type   = password {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.740139 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.auth_uri    = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.740499 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.auth_version = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.740852 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.cache       = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.741254 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.741675 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.certfile    = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.742214 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.delay_auth_decision = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.742607 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.742972 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.http_connect_timeout = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.743356 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.743710 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.identity_uri = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.744068 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.include_service_catalog = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.745667 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.insecure    = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.746477 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.interface   = public {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.747122 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.keyfile     = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.747793 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.748384 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.749076 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.749995 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.750619 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.751367 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.752100 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.752682 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.753401 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.753995 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.region_name = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.754621 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.755224 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.service_token_roles_required = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.755836 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.service_type = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.756415 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.token_cache_time = 300 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.757003 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.757715 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.backend                  = dogpile.cache.null {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.759629 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.backend_argument         = **** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.760379 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.config_prefix            = cache.oslo {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.761065 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.dead_timeout             = 60.0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.761691 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.debug_cache_backend      = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.762347 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:37:20.762542 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.enable_retry_client      = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.763799 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.enable_socket_keepalive  = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.764376 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.enabled                  = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.764968 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.expiration_time          = 600 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.765580 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.hashclient_retry_attempts = 2 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.766182 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.766798 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.memcache_dead_retry      = 300 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.767395 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.memcache_password        =  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.767988 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.768558 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.769223 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.memcache_pool_maxsize    = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.769840 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.770562 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.memcache_sasl_enabled    = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.771158 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.771734 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.772424 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.memcache_username        =  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.773029 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.proxies                  = [] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.773729 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.retry_attempts           = 2 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.774318 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.retry_delay              = 0.0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.774858 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.socket_keepalive_count   = 1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.775329 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.socket_keepalive_idle    = 1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.775810 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.socket_keepalive_interval = 1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.776268 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.tls_allowed_ciphers      = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.776731 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.tls_cafile               = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.778130 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.tls_certfile             = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.778693 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.tls_enabled              = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.779925 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cache.tls_keyfile              = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.780527 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] coordination.backend_url       = etcd3+http://10.222.0.36:2379 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.781021 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.backend               = sqlalchemy {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.781445 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.connection            = **** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.781977 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.connection_debug      = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.782682 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.connection_parameters =  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.783127 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.connection_recycle_time = 3600 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.783899 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.connection_trace      = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.784330 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.db_inc_retry_interval = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.784933 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.db_max_retries        = 20 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.785375 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.db_max_retry_interval = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.785840 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.db_retry_interval     = 1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.786279 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.max_overflow          = 50 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.788921 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.max_pool_size         = 5 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.789927 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.max_retries           = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.790522 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.mysql_enable_ndb      = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.791394 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.791977 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.pool_timeout          = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.793419 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.retry_interval        = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.795246 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.slave_connection      = **** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.795698 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.sqlite_synchronous    = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.796147 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] database.use_db_reconnect      = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.796633 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_policy.enforce_new_defaults = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.797060 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_policy.enforce_scope      = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.797540 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_policy.policy_default_rule = default {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.798002 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.798496 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_policy.policy_file        = policy.yaml {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.799717 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.800370 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.800978 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.801606 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.802203 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.802836 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] profiler.connection_string     = messaging:// {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.803624 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] profiler.enabled               = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.804122 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] profiler.es_doc_type           = notification {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.804661 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] profiler.es_scroll_size        = 10000 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.805134 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] profiler.es_scroll_time        = 2m {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.805653 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] profiler.filter_error_trace    = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.806119 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.806596 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] profiler.sentinel_service_name = mymaster {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.807089 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] profiler.socket_timeout        = 0.1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.807538 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] profiler.trace_sqlalchemy      = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.808046 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] privsep_osbrick.capabilities   = [21] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.808513 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] privsep_osbrick.group          = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.809058 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] privsep_osbrick.helper_command = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.809547 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] privsep_osbrick.logger_name    = oslo_privsep.daemon {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.810114 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.811209 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] privsep_osbrick.user           = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.811695 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.812142 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cinder_sys_admin.group         = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.812601 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cinder_sys_admin.helper_command = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.813058 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.813563 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.814000 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] cinder_sys_admin.user          = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.814475 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] service_user.auth_section      = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.814929 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] service_user.auth_type         = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.815385 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] service_user.cafile            = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.815838 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] service_user.certfile          = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.816310 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] service_user.collect_timing    = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.816895 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] service_user.insecure          = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.817346 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] service_user.keyfile           = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.817849 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] service_user.send_service_user_token = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.818322 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] service_user.split_loggers     = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.818773 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] service_user.timeout           = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.819314 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.backend_availability_zone = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.819795 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.820405 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.820884 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.chap_password = **** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.821354 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.chap_username =  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.821856 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.822433 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.822902 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.823381 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.driver_client_cert = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.823835 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.driver_client_cert_key = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.824296 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.driver_data_namespace = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.824864 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.825269 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.825657 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.driver_use_ssl = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.826050 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.enable_deferred_deletion = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.826406 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.enable_unsupported_driver = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.826853 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.827249 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.extra_capabilities = {} {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.827606 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.filter_function = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.827962 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.goodness_function = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.828350 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.iet_conf      = /etc/iet/ietd.conf {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.828727 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.829082 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.829437 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.834933 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.835337 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.835713 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.836105 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.836491 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.iscsi_target_flags =  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.836865 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.iscsi_write_cache = on {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.837257 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.iser_helper   = tgtadm {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.837854 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.iser_ip_address = 10.222.0.36 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.838226 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.iser_port     = 3260 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.838599 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.839003 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.839346 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.839724 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.num_shell_tries = 3 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.840134 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.840532 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.840932 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.nvmet_port_id = 1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.841625 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.842277 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.rados_connection_interval = 5 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.842917 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.rados_connection_retries = 3 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.843567 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.rbd_ceph_conf =  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.844348 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.844888 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.845562 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.846264 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.846924 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.rbd_pool      = rbd {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.847560 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.rbd_secret_uuid = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.848239 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.848871 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.rbd_user      = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.849630 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.850287 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.replication_device = **** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.850728 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.report_discard_supported = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.851085 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.851449 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.reserved_percentage = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.851817 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.scst_target_driver = iscsi {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.852169 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.scst_target_iqn_name = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.852541 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.storage_protocol = iSCSI {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.852895 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.853265 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.target_helper = tgtadm {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.853932 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.target_ip_address = 10.222.0.36 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.854310 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.target_port   = 3260 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.854699 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.855069 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.target_protocol = iscsi {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.855419 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.trace_flags   = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.855772 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.unique_fqdn_network = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.856131 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.use_chap_auth = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.856482 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.856829 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.volume_backend_name = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.857865 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.volume_clear  = zero {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.858214 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.volume_clear_ionice = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.858584 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.volume_clear_size = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.859108 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.859484 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.859850 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.860231 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.860706 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.861113 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_reports.file_event_handler = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.861519 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.861897 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_reports.log_dir           = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.862286 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.backend_availability_zone = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.862635 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.backend_host              = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.863011 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.backend_native_threads_pool_size = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.863357 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.backup_use_temp_snapshot  = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.863729 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.chap_password             = **** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.864119 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.chap_username             = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.864496 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.chiscsi_conf              = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.864801 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.deferred_deletion_delay   = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.865145 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.deferred_deletion_purge_interval = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.865593 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.driver_client_cert        = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.865917 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.driver_client_cert_key    = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.866424 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.driver_data_namespace     = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.866938 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.driver_ssl_cert_path      = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.867312 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:37:20.867605 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.driver_ssl_cert_verify    = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.868091 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.driver_use_ssl            = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.868603 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.enable_deferred_deletion  = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.869108 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.enable_unsupported_driver = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.869629 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.870164 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.extra_capabilities        = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.870663 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.filter_function           = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.871173 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.goodness_function         = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.871678 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.iet_conf                  = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.872172 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.image_upload_use_cinder_backend = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.873239 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.image_upload_use_internal_tenant = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.873865 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.image_volume_cache_enabled = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.874368 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.image_volume_cache_max_count = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.874943 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.875447 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.iscsi_iotype              = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.875960 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.876454 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.iscsi_target_flags        = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.876960 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.iscsi_write_cache         = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.877472 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.iser_helper               = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.877964 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.iser_ip_address           = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.878459 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.iser_port                 = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.879016 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.iser_target_prefix        = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.879535 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.max_over_subscription_ratio = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.880040 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.num_iser_scan_tries       = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.880554 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.num_shell_tries           = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.881073 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.num_volume_device_scan_tries = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.881616 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.nvmet_ns_id               = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.882111 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.nvmet_port_id             = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.882647 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.rados_connect_timeout     = -1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.883147 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.rados_connection_interval = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.883641 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.rados_connection_retries  = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.884154 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.rbd_ceph_conf             = /etc/ceph/ceph.conf {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.884665 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.rbd_cluster_name          = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.885159 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.885717 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.886241 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.rbd_max_clone_depth       = 5 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.886758 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.rbd_pool                  = volumes {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.887318 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.rbd_secret_uuid           = 2134f18b-29f2-4f2c-b4ab-e6816d91d1d7 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.887862 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.rbd_store_chunk_size      = 4 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.889866 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.rbd_user                  = cinder {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.890386 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.replication_connect_timeout = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.890910 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.replication_device        = **** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.891426 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.report_discard_supported  = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.892583 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.report_dynamic_total_capacity = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.893111 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.reserved_percentage       = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.893638 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.scst_target_driver        = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.894142 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.scst_target_iqn_name      = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.894661 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.storage_protocol          = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.895166 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.895675 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.target_helper             = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.896172 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.target_ip_address         = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.896837 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.target_port               = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.897536 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.target_prefix             = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.898199 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.target_protocol           = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.898723 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.trace_flags               = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.899231 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.unique_fqdn_network       = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.899728 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.use_chap_auth             = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.900234 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.use_multipath_for_image_xfer = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.900757 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.volume_backend_name       = ceph {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.901255 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.volume_clear              = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.901800 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.volume_clear_ionice       = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.902324 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.volume_clear_size         = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.902850 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.903404 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.volume_copy_bps_limit     = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.904126 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.volume_dd_blocksize       = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.904658 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.volume_driver             = cinder.volume.drivers.rbd.RBDDriver {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.905172 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ceph.volumes_dir               = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.905800 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.906515 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.907065 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.907414 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.907959 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.908449 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.908988 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.909513 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.910080 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.910766 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.913541 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.914155 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.914728 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.915299 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.915818 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.916358 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.916942 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.917728 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.918245 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.919008 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.920196 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.920726 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.921237 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.921787 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.922336 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.922747 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.driver [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] Driver hasn't implemented _init_vendor_properties()
Oct 29 20:37:20.923054 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.ssl      = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.923410 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.driver [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:75c89f35-4e51-4f7b-b3a2-c1f0fe460410:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=131780) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}}
Oct 29 20:37:20.923746 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.924278 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.924781 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.925342 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.925893 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.926372 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_notifications.driver = [] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.926893 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_notifications.retry = -1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.927456 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.927961 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] oslo_messaging_notifications.transport_url = **** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.928472 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.928919 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] key_manager.fixed_key          = **** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.929554 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.930072 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.barbican_api_version  = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.930594 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.barbican_endpoint     = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.931145 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.barbican_endpoint_type = public {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.931657 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.barbican_region_name  = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.932164 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.cafile                = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.933125 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.certfile              = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.933696 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.collect_timing        = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.934213 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.insecure              = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.934767 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.keyfile               = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.935848 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.number_of_retries     = 60 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.936355 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.retry_delay           = 1 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.936877 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.send_service_user_token = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.937369 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.split_loggers         = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.940983 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.timeout               = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.941105 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_db.sqlalchemy.engines [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}}
Oct 29 20:37:20.941676 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.verify_ssl            = True {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.942231 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican.verify_ssl_path       = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.942767 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican_service_user.auth_section = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.943286 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican_service_user.auth_type = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.943788 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican_service_user.cafile   = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.944297 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican_service_user.certfile = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.944882 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican_service_user.collect_timing = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.945185 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writer thread running {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Oct 29 20:37:20.945585 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican_service_user.insecure = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.946095 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican_service_user.keyfile  = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.946611 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican_service_user.split_loggers = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.947111 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] barbican_service_user.timeout  = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.947648 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.approle_role_id          = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.948142 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.approle_secret_id        = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.948636 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.cafile                   = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.949129 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.certfile                 = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.949662 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.collect_timing           = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.950181 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.insecure                 = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.950696 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.keyfile                  = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.951215 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.kv_mountpoint            = secret {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.951732 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.kv_version               = 2 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.952225 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.namespace                = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.952735 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.root_token_id            = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.953240 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.split_loggers            = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.955155 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.ssl_ca_crt_file          = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.955863 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.timeout                  = None {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.956403 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.use_ssl                  = False {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.956928 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Oct 29 20:37:20.957382 ncdv-master-1 cinder-volume[131610]: DEBUG oslo_service.service [None req-5238c225-f8d4-4815-bb87-bc8460e6cd01 None None] ******************************************************************************** {{(pid=131610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Oct 29 20:37:20.984979 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.db.sqlalchemy.api [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] Building query based on filter {{(pid=131780) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3885}}
Oct 29 20:37:21.005403 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.image_utils [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=131780) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:991}}
Oct 29 20:37:21.014859 ncdv-master-1 cinder-volume[131780]: INFO cinder.keymgr.migration [None req-0b92951f-3087-4277-9f40-5a0fd825ebed None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Oct 29 20:37:21.018626 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:37:21.051780 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:37:21.083466 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:37:21.138739 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] Driver initialization completed successfully.
Oct 29 20:37:21.139671 ncdv-master-1 cinder-volume[131780]: INFO cinder.manager [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] Initiating service 3 cleanup
Oct 29 20:37:21.156780 ncdv-master-1 cinder-volume[131780]: INFO cinder.manager [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] Service 3 cleanup completed.
Oct 29 20:37:21.157151 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.service [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] Creating RPC server for service cinder-volume {{(pid=131780) start /opt/stack/cinder/cinder/service.py:238}}
Oct 29 20:37:21.168958 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.service [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=131780) start /opt/stack/cinder/cinder/service.py:244}}
Oct 29 20:37:21.242618 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] Initializing RPC dependent components of volume driver RBDDriver (1.3.0)
Oct 29 20:37:21.242618 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:37:21.281071 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:37:21.336373 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-d6f757a9-1d4e-4d91-a774-a66432c7de37 None None] Driver post RPC initialization completed successfully.
Oct 29 20:37:30.611286 ncdv-master-1 cinder-volume[131610]: DEBUG dbcounter [-] [131610] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=131610) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:37:31.330447 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=22,cinder:INSERT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:37:31.332719 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:38:11.338912 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:38:11.339657 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:38:31.343257 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:38:51.345011 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:39:01.338924 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:39:01.339489 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:39:01.368132 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:39:01.370929 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:39:01.394865 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:39:21.372987 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:39:31.374409 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:39:51.381920 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:40:01.344046 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:40:01.344741 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:40:01.374843 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:40:01.399774 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:40:01.403644 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:40:21.404920 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:40:41.413071 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:40:51.419423 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:41:01.344455 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:41:01.345495 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:41:01.373054 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:41:01.403470 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:41:11.422512 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:41:21.430806 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:41:41.431086 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:41:51.439556 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:42:01.348156 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:42:01.348806 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:42:01.371431 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:42:01.395085 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:42:11.439891 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:42:21.447863 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:42:41.449696 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:42:51.457668 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:43:01.352030 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:43:01.352669 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:43:01.376213 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:43:01.398738 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:43:11.458140 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:43:21.467571 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:43:41.468538 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:44:01.354783 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:44:01.355454 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:44:01.377239 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:44:01.399386 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:44:01.474537 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:44:21.480164 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:44:31.484030 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:44:41.490266 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:45:01.355071 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:45:01.355903 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:45:01.380919 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:45:01.403668 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:45:01.492751 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:45:11.501122 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:45:31.502199 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:45:51.506564 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:46:01.363385 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:46:01.363385 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:46:01.409482 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:46:01.452125 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:46:01.516638 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:46:21.520467 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:46:31.529438 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:46:51.530872 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:47:01.359369 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:47:01.360213 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:47:01.473839 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:47:01.555495 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:47:01.564527 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:47:31.564652 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:47:41.556247 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:48:01.357956 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:48:01.358468 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:48:01.414223 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:48:01.488307 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:48:01.561643 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:48:21.556170 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:48:41.562124 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:48:52.669760 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:48:52.751299 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 20:48:52.819263 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Flow 'volume_create_manager' (e49d3e21-cb11-4498-adbb-9a80106b2268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:48:52.832851 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa697694-59a1-4911-a144-198a6f9311c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:48:52.911013 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa697694-59a1-4911-a144-198a6f9311c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T20:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1562602298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2214e232-d1fe-4255-9dd8-84ea44b0fb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe32b0a32524e2bbaa26501305d418b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T20:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T20:48:53Z,use_quota=True,user_id='91932364eb4e4742b5f7fc998d202a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:48:52.917948 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31bc28dc-05e9-4a7c-8e02-5fdbf5e682b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:48:52.922996 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31bc28dc-05e9-4a7c-8e02-5fdbf5e682b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:48:52.928657 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6dee71-eaa0-4ffa-9ebf-fbf980c2a5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:48:53.179181 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6dee71-eaa0-4ffa-9ebf-fbf980c2a5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2214e232-d1fe-4255-9dd8-84ea44b0fb7b', 'volume_name': 'volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9346abbdf0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:48:53.184158 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0cfee35-b97c-4903-b01b-e927f7a08c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:48:53.200524 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0cfee35-b97c-4903-b01b-e927f7a08c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:48:53.223984 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad87c81-c7f0-4c81-a8fc-7e52ba8c6f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:48:53.227950 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Volume 2214e232-d1fe-4255-9dd8-84ea44b0fb7b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9346abbdf0>}
Oct 29 20:48:53.234977 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Cloning 2214e232-d1fe-4255-9dd8-84ea44b0fb7b from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 20:48:53.234977 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 20:48:53.265413 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.032s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 20:48:53.294840 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Preparing cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:891}}
Oct 29 20:48:53.295949 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 20:49:01.363207 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:49:01.371047 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:49:01.473859 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:49:01.590980 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:49:11.603790 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=11,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:49:14.974549 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.image_utils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph, size 616.00 MB, duration 21.65 sec {{(pid=131780) fetch /opt/stack/cinder/cinder/image/image_utils.py:587}}
Oct 29 20:49:14.974549 ncdv-master-1 cinder-volume[131780]: INFO cinder.image.image_utils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Image download 616.00 MB at 28.45 MB/s
Oct 29 20:49:15.020071 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:49:15.130503 ncdv-master-1 sudo[142486]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph
Oct 29 20:49:15.131332 ncdv-master-1 sudo[142486]: pam_unix(sudo:session): session opened for user root by (uid=0)
Oct 29 20:49:17.279030 ncdv-master-1 sudo[142486]: pam_unix(sudo:session): session closed for user root
Oct 29 20:49:17.281531 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph" returned: 0 in 2.262s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:49:17.282893 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.image_utils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Temporary image 1a2bec42-cf5e-436b-826e-51ea67e041f7 is fetched for user 91932364eb4e4742b5f7fc998d202a70. {{(pid=131780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1124}}
Oct 29 20:49:17.388310 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:49:17.515631 ncdv-master-1 sudo[142506]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph
Oct 29 20:49:17.516480 ncdv-master-1 sudo[142506]: pam_unix(sudo:session): session opened for user root by (uid=0)
Oct 29 20:49:19.253876 ncdv-master-1 sudo[142506]: pam_unix(sudo:session): session closed for user root
Oct 29 20:49:19.256201 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph" returned: 0 in 1.868s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:49:19.257709 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] creating volume 'volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 20:49:19.259213 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:49:19.431134 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 20:49:19.431842 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 20:49:19.480092 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Attempting download of 1a2bec42-cf5e-436b-826e-51ea67e041f7 ((None, None)) to volume 2214e232-d1fe-4255-9dd8-84ea44b0fb7b. {{(pid=131780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Oct 29 20:49:19.534831 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_1a2bec42-cf5e-436b-826e-51ea67e041f7_57udu146 {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:49:19.651834 ncdv-master-1 sudo[142545]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_1a2bec42-cf5e-436b-826e-51ea67e041f7_57udu146
Oct 29 20:49:19.652650 ncdv-master-1 sudo[142545]: pam_unix(sudo:session): session opened for user root by (uid=0)
Oct 29 20:49:21.181085 ncdv-master-1 sudo[142545]: pam_unix(sudo:session): session closed for user root
Oct 29 20:49:21.184407 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_1a2bec42-cf5e-436b-826e-51ea67e041f7_57udu146" returned: 0 in 1.649s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:49:21.186276 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:49:21.289619 ncdv-master-1 sudo[142562]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph
Oct 29 20:49:21.291113 ncdv-master-1 sudo[142562]: pam_unix(sudo:session): session opened for user root by (uid=0)
Oct 29 20:49:22.953147 ncdv-master-1 sudo[142562]: pam_unix(sudo:session): session closed for user root
Oct 29 20:49:22.955356 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph" returned: 0 in 1.769s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:49:22.956251 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.image_utils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] 1a2bec42-cf5e-436b-826e-51ea67e041f7 was vhdx, converting to raw {{(pid=131780) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:825}}
Oct 29 20:49:22.958049 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpu6iqdah_ {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:49:22.977783 ncdv-master-1 sudo[142568]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpu6iqdah_
Oct 29 20:49:22.978595 ncdv-master-1 sudo[142568]: pam_unix(sudo:session): session opened for user root by (uid=0)
Oct 29 20:49:25.338615 ncdv-master-1 sudo[142568]: pam_unix(sudo:session): session closed for user root
Oct 29 20:49:25.342248 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpu6iqdah_" returned: 0 in 2.384s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:49:25.344834 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:49:25.462126 ncdv-master-1 sudo[142584]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph
Oct 29 20:49:25.463527 ncdv-master-1 sudo[142584]: pam_unix(sudo:session): session opened for user root by (uid=0)
Oct 29 20:49:26.712726 ncdv-master-1 sudo[142584]: pam_unix(sudo:session): session closed for user root
Oct 29 20:49:26.715637 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph" returned: 0 in 1.371s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:49:26.716582 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.image_utils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a2bec42-cf5e-436b-826e-51ea67e041f7_tgmamznbncdv-master-1@ceph, size 700.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/conversion/tmpu6iqdah_ {{(pid=131780) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:419}}
Oct 29 20:49:26.717037 ncdv-master-1 cinder-volume[131780]: INFO cinder.image.image_utils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Converted 700.00 MB image at 293.29 MB/s
Oct 29 20:49:26.718635 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:49:26.811973 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 20:49:26.815630 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 20:49:26.841821 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] deleting rbd volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 20:49:27.096248 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpu6iqdah_ volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:49:31.606372 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:49:31.904203 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpu6iqdah_ volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 4.809s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:49:32.144392 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:49:32.395518 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 20:49:32.397329 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 20:49:32.398252 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Downloaded image 1a2bec42-cf5e-436b-826e-51ea67e041f7 ((None, None)) to volume 2214e232-d1fe-4255-9dd8-84ea44b0fb7b successfully. {{(pid=131780) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}}
Oct 29 20:49:32.477702 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.image_utils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Temporary image 1a2bec42-cf5e-436b-826e-51ea67e041f7 for user 91932364eb4e4742b5f7fc998d202a70 is deleted. {{(pid=131780) fetch /opt/stack/cinder/cinder/image/image_utils.py:1128}}
Oct 29 20:49:32.588157 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota.
Oct 29 20:49:32.589063 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota.
Oct 29 20:49:32.699146 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Created reservations ['78870d4e-d6be-427d-8da7-71e8d227a241', '2aafa038-ece1-46d1-9807-bcc0f2b9e080', '08347f50-819c-4d2d-a0b2-1f7ff880b190', '0e775f71-ad90-426a-82bb-8610f4a49e54'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 20:49:32.733476 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Creating image volume entry: {'volume_admin_metadata': [], 'service_uuid': None, 'replication_status': None, 'terminated_at': None, 'created_at': datetime.datetime(2022, 10, 29, 20, 48, 51, tzinfo=datetime.timezone.utc), 'ec2_id': None, 'user_id': '91932364eb4e4742b5f7fc998d202a70', 'provider_id': None, 'multiattach': False, 'replication_extended_status': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'display_description': None, 'bootable': False, 'updated_at': datetime.datetime(2022, 10, 29, 20, 48, 53, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'group_id': None, 'host': 'ncdv-master-1@ceph#ceph', 'provider_auth': None, 'provider_geometry': None, 'metadata': {}, 'consistencygroup_id': None, 'provider_location': None, 'display_name': 'image-1a2bec42-cf5e-436b-826e-51ea67e041f7', 'encryption_key_id': None, 'cluster_name': None, 'deleted': False, 'project_id': 'c86e80b1bf7a40cda83640c69ce1e1c4', 'launched_at': None, 'previous_status': None, 'scheduled_at': datetime.datetime(2022, 10, 29, 20, 48, 53, tzinfo=datetime.timezone.utc), 'volume_type_id': '515a8a7b-db02-4220-a920-c2fe36d654f8', 'size': 1, 'volume_metadata': [], 'replication_driver_data': None, 'shared_targets': True, 'availability_zone': 'nova', 'attach_status': 'detached', 'status': 'creating', 'source_volid': '2214e232-d1fe-4255-9dd8-84ea44b0fb7b'}. {{(pid=131780) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1660}}
Oct 29 20:49:32.884019 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Volume reschedule parameters: False retry: None {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 20:49:32.935359 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Flow 'volume_create_manager' (24aefaf5-f3b7-424d-986e-bae446bcff0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:49:32.950079 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6337bd3b-c041-44ef-8902-859f268d82e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:49:32.982634 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6337bd3b-c041-44ef-8902-859f268d82e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T20:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='image-1a2bec42-cf5e-436b-826e-51ea67e041f7',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fbe0dd2e-351a-4779-844d-3c66baf14939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c86e80b1bf7a40cda83640c69ce1e1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T20:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=2214e232-d1fe-4255-9dd8-84ea44b0fb7b,status='creating',terminated_at=None,updated_at=2022-10-29T20:48:53Z,use_quota=True,user_id='91932364eb4e4742b5f7fc998d202a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:49:32.992634 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2073eb4-55ac-45a2-aaa1-d5b52b080ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:49:32.999531 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2073eb4-55ac-45a2-aaa1-d5b52b080ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:49:33.018186 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3145ca2e-7edf-4f3e-8801-37419c4b5340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:49:33.038104 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3145ca2e-7edf-4f3e-8801-37419c4b5340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'volume_name': 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939', 'volume_size': 1, 'source_volid': '2214e232-d1fe-4255-9dd8-84ea44b0fb7b', 'source_volstatus': 'downloading'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:49:33.043784 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9895758b-e403-4911-9e78-65daec58e381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:49:33.049875 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9895758b-e403-4911-9e78-65daec58e381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:49:33.054671 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33413e07-e200-4bb9-9653-267ee6e9c8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:49:33.055841 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Volume fbe0dd2e-351a-4779-844d-3c66baf14939: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939', 'volume_size': 1, 'source_volid': '2214e232-d1fe-4255-9dd8-84ea44b0fb7b', 'source_volstatus': 'downloading'}
Oct 29 20:49:33.072163 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:49:33.158147 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] creating snapshot='volume-fbe0dd2e-351a-4779-844d-3c66baf14939.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 20:49:33.731466 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] cloning 'volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b@volume-fbe0dd2e-351a-4779-844d-3c66baf14939.clone_snap' to 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 20:49:33.895157 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 20:49:33.897041 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 20:49:33.897429 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 20:49:33.947927 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 20:49:33.952524 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33413e07-e200-4bb9-9653-267ee6e9c8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939', 'volume_size': 1, 'source_volid': '2214e232-d1fe-4255-9dd8-84ea44b0fb7b', 'source_volstatus': 'downloading'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:49:33.959712 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1aec1d-e03a-46f1-8ed2-1f4191b9446b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:49:33.982757 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Volume volume-fbe0dd2e-351a-4779-844d-3c66baf14939 (fbe0dd2e-351a-4779-844d-3c66baf14939): created successfully
Oct 29 20:49:33.989890 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1aec1d-e03a-46f1-8ed2-1f4191b9446b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:49:34.003554 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Flow 'volume_create_manager' (24aefaf5-f3b7-424d-986e-bae446bcff0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:49:34.027040 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Created volume successfully.
Oct 29 20:49:34.090728 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Creating new image-volume cache entry for image 1a2bec42-cf5e-436b-826e-51ea67e041f7 on ncdv-master-1@ceph#ceph {{(pid=131780) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}}
Oct 29 20:49:34.109074 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] New image-volume cache entry created: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 20, 49, 34, 94895)}. {{(pid=131780) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}}
Oct 29 20:49:34.119313 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 40.850s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 20:49:34.119313 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Marking volume 2214e232-d1fe-4255-9dd8-84ea44b0fb7b as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 20:49:34.132454 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to 2214e232-d1fe-4255-9dd8-84ea44b0fb7b. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 20:49:34.133140 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Creating volume glance metadata for volume 2214e232-d1fe-4255-9dd8-84ea44b0fb7b backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 20:49:34.254438 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad87c81-c7f0-4c81-a8fc-7e52ba8c6f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9346abbdf0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:49:34.268637 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a85730d-1244-4784-aa72-e65d27afc48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:49:34.291522 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b (2214e232-d1fe-4255-9dd8-84ea44b0fb7b): created successfully
Oct 29 20:49:34.296799 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a85730d-1244-4784-aa72-e65d27afc48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:49:34.307020 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Flow 'volume_create_manager' (e49d3e21-cb11-4498-adbb-9a80106b2268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:49:34.328544 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b1eeedef-81f6-4a98-980c-52d67be18f96 tempest-ServersTestBootFromVolume-735731105 None] Created volume successfully.
Oct 29 20:49:40.367490 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-22e1949e-4229-44ba-aa01-d1a86313c0dd req-6a3cef63-ca40-4ca0-8993-4b5439e442fe tempest-ServersTestBootFromVolume-735731105 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:49:42.075665 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-22e1949e-4229-44ba-aa01-d1a86313c0dd req-6a3cef63-ca40-4ca0-8993-4b5439e442fe tempest-ServersTestBootFromVolume-735731105 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.707s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:49:42.077488 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-22e1949e-4229-44ba-aa01-d1a86313c0dd req-6a3cef63-ca40-4ca0-8993-4b5439e442fe tempest-ServersTestBootFromVolume-735731105 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '2214e232-d1fe-4255-9dd8-84ea44b0fb7b', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:49:42.141335 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=48,cinder:UPDATE=17,cinder:INSERT=9,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:49:42.189784 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-22e1949e-4229-44ba-aa01-d1a86313c0dd req-6a3cef63-ca40-4ca0-8993-4b5439e442fe tempest-ServersTestBootFromVolume-735731105 None] Connection info returned from driver {'name': 'volumes/volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2214e232-d1fe-4255-9dd8-84ea44b0fb7b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ed45492a-d1f0-4f22-aa33-b9b77778b101'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:49:42.273272 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-22e1949e-4229-44ba-aa01-d1a86313c0dd req-6a3cef63-ca40-4ca0-8993-4b5439e442fe tempest-ServersTestBootFromVolume-735731105 None] attachment_update completed successfully.
Oct 29 20:50:01.363438 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:50:01.364828 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:50:01.410659 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:50:01.446726 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:50:11.597081 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=51,cinder:INSERT=15,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:50:21.601967 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:50:31.615606 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:50:51.627914 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:50:51.629987 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:51:01.364165 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:51:01.366598 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:51:01.436276 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:51:01.531666 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:51:12.633085 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-d30b77fd-75a9-404b-b7a6-31531780c7bd req-1802bbfa-9825-4500-93a7-8d3306f5a04e tempest-ServersTestBootFromVolume-735731105 None] Terminate volume connection completed successfully.
Oct 29 20:51:12.633904 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-d30b77fd-75a9-404b-b7a6-31531780c7bd req-1802bbfa-9825-4500-93a7-8d3306f5a04e tempest-ServersTestBootFromVolume-735731105 None] Deleting attachment ed45492a-d1f0-4f22-aa33-b9b77778b101. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 20:51:12.875781 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-d30b77fd-75a9-404b-b7a6-31531780c7bd req-5abca902-8f4e-4e80-a418-940bdbaba141 tempest-ServersTestBootFromVolume-735731105 None] Acquiring lock "cinder-2214e232-d1fe-4255-9dd8-84ea44b0fb7b-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 20:51:12.890137 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-d30b77fd-75a9-404b-b7a6-31531780c7bd req-5abca902-8f4e-4e80-a418-940bdbaba141 tempest-ServersTestBootFromVolume-735731105 None] Lock "cinder-2214e232-d1fe-4255-9dd8-84ea44b0fb7b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 20:51:12.942778 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-d30b77fd-75a9-404b-b7a6-31531780c7bd req-5abca902-8f4e-4e80-a418-940bdbaba141 tempest-ServersTestBootFromVolume-735731105 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:51:13.019017 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-d30b77fd-75a9-404b-b7a6-31531780c7bd req-5abca902-8f4e-4e80-a418-940bdbaba141 tempest-ServersTestBootFromVolume-735731105 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 20:51:13.020336 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-d30b77fd-75a9-404b-b7a6-31531780c7bd req-5abca902-8f4e-4e80-a418-940bdbaba141 tempest-ServersTestBootFromVolume-735731105 None] volume has clone snapshot(s) {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1378}}
Oct 29 20:51:13.021915 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-d30b77fd-75a9-404b-b7a6-31531780c7bd req-5abca902-8f4e-4e80-a418-940bdbaba141 tempest-ServersTestBootFromVolume-735731105 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 20:51:13.221192 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [req-d30b77fd-75a9-404b-b7a6-31531780c7bd req-5abca902-8f4e-4e80-a418-940bdbaba141 tempest-ServersTestBootFromVolume-735731105 None] Created reservations ['2ff15b99-b2b7-4a76-94a7-f569615fab20', '9546fc9a-8b65-4b51-b6fb-0a4286172c56', '64494147-456e-4568-9065-e4f427e28b9d', '1cf9d4a2-8cc5-41fc-ba56-eb82e6503811'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 20:51:13.326958 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-d30b77fd-75a9-404b-b7a6-31531780c7bd req-5abca902-8f4e-4e80-a418-940bdbaba141 tempest-ServersTestBootFromVolume-735731105 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:51:13.390379 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-d30b77fd-75a9-404b-b7a6-31531780c7bd req-5abca902-8f4e-4e80-a418-940bdbaba141 tempest-ServersTestBootFromVolume-735731105 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:51:13.463123 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [req-d30b77fd-75a9-404b-b7a6-31531780c7bd req-5abca902-8f4e-4e80-a418-940bdbaba141 tempest-ServersTestBootFromVolume-735731105 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:51:13.468820 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-d30b77fd-75a9-404b-b7a6-31531780c7bd req-5abca902-8f4e-4e80-a418-940bdbaba141 tempest-ServersTestBootFromVolume-735731105 None] Deleted volume successfully.
Oct 29 20:51:13.493062 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-d30b77fd-75a9-404b-b7a6-31531780c7bd req-5abca902-8f4e-4e80-a418-940bdbaba141 tempest-ServersTestBootFromVolume-735731105 None] Lock "cinder-2214e232-d1fe-4255-9dd8-84ea44b0fb7b-delete_volume" released by "delete_volume" :: held 0.603s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 20:51:30.802413 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=22,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:51:30.806023 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=20,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:51:30.844767 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 20:51:30.889612 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Flow 'volume_create_manager' (adafff15-d90f-453f-bcc7-dc9110353736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:51:30.897238 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f15665-503f-48d4-ad0b-10f0974e45e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:30.928458 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f15665-503f-48d4-ad0b-10f0974e45e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T20:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-240516664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=336b3749-7436-45c4-b9f6-b8dd40a60951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ddac3a85fca49df9c83c7863e9d3ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T20:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T20:51:31Z,use_quota=True,user_id='47e571be08a14d40951a503df48a7c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:30.945892 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7779189a-bd2d-41c9-98a7-0ac3bd5c55b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:30.970153 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7779189a-bd2d-41c9-98a7-0ac3bd5c55b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:30.990477 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323ed05f-8f15-46ce-a666-c1860956faef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:31.157694 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323ed05f-8f15-46ce-a666-c1860956faef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '336b3749-7436-45c4-b9f6-b8dd40a60951', 'volume_name': 'volume-336b3749-7436-45c4-b9f6-b8dd40a60951', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9346abb5b0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:31.162631 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddf9bb1-d308-4277-975e-b945977c72a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:31.179353 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddf9bb1-d308-4277-975e-b945977c72a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:31.190903 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b0c69c-7a06-442d-b6ba-194a253e5030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:31.194679 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Volume 336b3749-7436-45c4-b9f6-b8dd40a60951: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-336b3749-7436-45c4-b9f6-b8dd40a60951', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9346abb5b0>}
Oct 29 20:51:31.196110 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Cloning 336b3749-7436-45c4-b9f6-b8dd40a60951 from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 20:51:31.205089 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 20:51:31.235796 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.031s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 20:51:31.264260 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 20, 51, 31, 240800)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 20:51:31.265578 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 20:51:31.266195 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Found cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 29 20:51:31.271505 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 0.036s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 20:51:31.272661 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 20:51:31.290404 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 20, 51, 31, 286620)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 20:51:31.291186 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 20:51:31.292269 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Creating from source image-volume fbe0dd2e-351a-4779-844d-3c66baf14939 {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 29 20:51:31.307219 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:51:31.399193 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] creating snapshot='volume-336b3749-7436-45c4-b9f6-b8dd40a60951.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 20:51:31.711556 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] cloning 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939@volume-336b3749-7436-45c4-b9f6-b8dd40a60951.clone_snap' to 'volume-336b3749-7436-45c4-b9f6-b8dd40a60951' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 20:51:31.908183 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 20:51:31.910100 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 20:51:31.910671 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 20:51:31.953546 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 20:51:31.956957 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Marking volume 336b3749-7436-45c4-b9f6-b8dd40a60951 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 20:51:31.975442 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to 336b3749-7436-45c4-b9f6-b8dd40a60951. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 20:51:31.976297 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Creating volume glance metadata for volume 336b3749-7436-45c4-b9f6-b8dd40a60951 backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 20:51:32.066005 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b0c69c-7a06-442d-b6ba-194a253e5030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336b3749-7436-45c4-b9f6-b8dd40a60951', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9346abb5b0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:32.076909 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b60cdd-5e1b-4a9d-beba-a6860d7bc15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:32.098361 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Volume volume-336b3749-7436-45c4-b9f6-b8dd40a60951 (336b3749-7436-45c4-b9f6-b8dd40a60951): created successfully
Oct 29 20:51:32.106378 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b60cdd-5e1b-4a9d-beba-a6860d7bc15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:32.112482 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Flow 'volume_create_manager' (adafff15-d90f-453f-bcc7-dc9110353736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:51:32.126029 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-d3dfe511-fc5f-4e5a-a77e-e8f3077973ec tempest-TaggedBootDevicesTest-1807794048 None] Created volume successfully.
Oct 29 20:51:33.866362 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 20:51:33.920936 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Flow 'volume_create_manager' (3bd707a8-635b-44a9-bf06-08949c56806b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:51:33.940801 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa6386d-8559-4243-99d6-4b5926c329b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:33.963406 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa6386d-8559-4243-99d6-4b5926c329b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T20:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1389296566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f4a8a96-dc7e-47f8-b92d-9dd0700c950a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ddac3a85fca49df9c83c7863e9d3ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T20:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T20:51:34Z,use_quota=True,user_id='47e571be08a14d40951a503df48a7c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:33.970399 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e993bd97-565e-432b-a73c-ef1909450683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:33.975588 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e993bd97-565e-432b-a73c-ef1909450683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:33.980965 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a5bf98-e6dd-4b93-90c6-aac3533ad0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:33.987048 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a5bf98-e6dd-4b93-90c6-aac3533ad0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f4a8a96-dc7e-47f8-b92d-9dd0700c950a', 'volume_name': 'volume-2f4a8a96-dc7e-47f8-b92d-9dd0700c950a', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:33.993780 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dd8574-caba-48ab-92b0-54429e8c78f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:33.998005 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dd8574-caba-48ab-92b0-54429e8c78f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:34.002572 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e05ec00-7f3c-45d2-8545-8af020224266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:34.004598 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Volume 2f4a8a96-dc7e-47f8-b92d-9dd0700c950a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f4a8a96-dc7e-47f8-b92d-9dd0700c950a', 'volume_size': 1}
Oct 29 20:51:34.005199 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] creating volume 'volume-2f4a8a96-dc7e-47f8-b92d-9dd0700c950a' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 20:51:34.006183 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:51:34.150264 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 20:51:34.150867 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 20:51:34.155130 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e05ec00-7f3c-45d2-8545-8af020224266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f4a8a96-dc7e-47f8-b92d-9dd0700c950a', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:34.168354 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd6bfec-a768-4754-a104-b794edc89799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:34.192614 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Volume volume-2f4a8a96-dc7e-47f8-b92d-9dd0700c950a (2f4a8a96-dc7e-47f8-b92d-9dd0700c950a): created successfully
Oct 29 20:51:34.196686 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd6bfec-a768-4754-a104-b794edc89799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:34.212508 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Flow 'volume_create_manager' (3bd707a8-635b-44a9-bf06-08949c56806b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:51:34.235067 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-42194ee6-8671-418e-a0f4-b4252bce231a tempest-TaggedBootDevicesTest-1807794048 None] Created volume successfully.
Oct 29 20:51:35.305968 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 20:51:35.350381 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Flow 'volume_create_manager' (5353dd0b-fc8a-4d8a-8b92-2c14f46107cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:51:35.357344 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5b32a1-06d0-4b2e-9d92-a712feb0c43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:35.404710 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5b32a1-06d0-4b2e-9d92-a712feb0c43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T20:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-107421063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=56ccb44a-a3fa-40da-ab2a-b3e0884aaba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ddac3a85fca49df9c83c7863e9d3ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T20:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T20:51:35Z,use_quota=True,user_id='47e571be08a14d40951a503df48a7c3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:35.414855 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fae06f-04dd-4d51-9f4b-4ed0661a6506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:35.426583 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fae06f-04dd-4d51-9f4b-4ed0661a6506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:35.441903 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5bd69b-75ab-4f48-b6f2-334a7c92877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:35.446116 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5bd69b-75ab-4f48-b6f2-334a7c92877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56ccb44a-a3fa-40da-ab2a-b3e0884aaba6', 'volume_name': 'volume-56ccb44a-a3fa-40da-ab2a-b3e0884aaba6', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:35.459911 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741017de-a26a-43cc-ab2f-1351a8fd96ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:35.470868 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741017de-a26a-43cc-ab2f-1351a8fd96ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:35.480405 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8d83cb-c4d3-4b2b-8c98-8dbfeafcd2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:35.483848 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Volume 56ccb44a-a3fa-40da-ab2a-b3e0884aaba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56ccb44a-a3fa-40da-ab2a-b3e0884aaba6', 'volume_size': 1}
Oct 29 20:51:35.484312 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] creating volume 'volume-56ccb44a-a3fa-40da-ab2a-b3e0884aaba6' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 20:51:35.486106 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:51:35.615168 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 20:51:35.615795 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 20:51:35.620095 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8d83cb-c4d3-4b2b-8c98-8dbfeafcd2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ccb44a-a3fa-40da-ab2a-b3e0884aaba6', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:35.627433 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cfe0a8-39f6-46d2-8806-d5629a7c181a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:35.647466 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Volume volume-56ccb44a-a3fa-40da-ab2a-b3e0884aaba6 (56ccb44a-a3fa-40da-ab2a-b3e0884aaba6): created successfully
Oct 29 20:51:35.652017 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cfe0a8-39f6-46d2-8806-d5629a7c181a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:35.662830 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Flow 'volume_create_manager' (5353dd0b-fc8a-4d8a-8b92-2c14f46107cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:51:35.682191 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-724e22ff-6d2c-4567-b5a7-8d0d94ac7b90 tempest-TaggedBootDevicesTest-1807794048 None] Created volume successfully.
Oct 29 20:51:47.868334 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 20:51:47.891723 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Flow 'volume_create_manager' (7a0bd0bc-7001-405b-9f3f-7e3306e3104a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:51:47.900035 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073ab171-79ac-44fd-81eb-4ca3b482e0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:47.917062 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073ab171-79ac-44fd-81eb-4ca3b482e0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T20:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-685268522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=dc75a1bd-8bf7-49a6-adb1-547033153d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d373d98fd667430fac145e2e63249419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T20:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T20:51:48Z,use_quota=True,user_id='869b7117eab8443e9cbb52400b875ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:47.923018 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02dc473-7757-41d3-89cc-28e3cc031b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:47.927229 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02dc473-7757-41d3-89cc-28e3cc031b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:47.932402 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5397a7-35ff-489f-b845-88b46f2df2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:47.936639 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5397a7-35ff-489f-b845-88b46f2df2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc75a1bd-8bf7-49a6-adb1-547033153d04', 'volume_name': 'volume-dc75a1bd-8bf7-49a6-adb1-547033153d04', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:47.942079 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263842fe-0fbf-4211-8d2b-09762b4c737e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:47.947278 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263842fe-0fbf-4211-8d2b-09762b4c737e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:47.953618 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9137005-e6a2-4fd2-8a67-5b2c346e0296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:47.954737 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Volume dc75a1bd-8bf7-49a6-adb1-547033153d04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc75a1bd-8bf7-49a6-adb1-547033153d04', 'volume_size': 1}
Oct 29 20:51:47.955145 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] creating volume 'volume-dc75a1bd-8bf7-49a6-adb1-547033153d04' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 20:51:47.956095 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:51:48.073955 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 20:51:48.074961 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 20:51:48.078777 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9137005-e6a2-4fd2-8a67-5b2c346e0296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc75a1bd-8bf7-49a6-adb1-547033153d04', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:48.084928 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36149541-d1e2-418c-8a01-7444857231f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:51:48.098882 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Volume volume-dc75a1bd-8bf7-49a6-adb1-547033153d04 (dc75a1bd-8bf7-49a6-adb1-547033153d04): created successfully
Oct 29 20:51:48.102820 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36149541-d1e2-418c-8a01-7444857231f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:51:48.114176 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Flow 'volume_create_manager' (7a0bd0bc-7001-405b-9f3f-7e3306e3104a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:51:48.140264 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-ffce2eb6-783b-4fac-add7-84823f38c308 tempest-LiveMigrationTest-2002133718 None] Created volume successfully.
Oct 29 20:51:49.917756 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-7da99ca5-cc84-4cdf-a32d-e8237cdc4151 req-295c4693-cf06-4a2f-b9fe-0fda401c582a tempest-LiveMigrationTest-2002133718 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:51:51.778652 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-7da99ca5-cc84-4cdf-a32d-e8237cdc4151 req-295c4693-cf06-4a2f-b9fe-0fda401c582a tempest-LiveMigrationTest-2002133718 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.860s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:51:51.779605 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-7da99ca5-cc84-4cdf-a32d-e8237cdc4151 req-295c4693-cf06-4a2f-b9fe-0fda401c582a tempest-LiveMigrationTest-2002133718 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dc75a1bd-8bf7-49a6-adb1-547033153d04', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'dc75a1bd-8bf7-49a6-adb1-547033153d04', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:51:51.825981 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-7da99ca5-cc84-4cdf-a32d-e8237cdc4151 req-295c4693-cf06-4a2f-b9fe-0fda401c582a tempest-LiveMigrationTest-2002133718 None] Connection info returned from driver {'name': 'volumes/volume-dc75a1bd-8bf7-49a6-adb1-547033153d04', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dc75a1bd-8bf7-49a6-adb1-547033153d04', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6091f033-32ab-46b0-ab97-45cc04db2362'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:51:51.945010 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-7da99ca5-cc84-4cdf-a32d-e8237cdc4151 req-295c4693-cf06-4a2f-b9fe-0fda401c582a tempest-LiveMigrationTest-2002133718 None] attachment_update completed successfully.
Oct 29 20:52:01.368521 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:52:01.369235 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:52:01.446920 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:52:01.527096 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:52:01.722632 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=40,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:52:01.724813 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=44,cinder:UPDATE=9,cinder:INSERT=12,cinder:DELETE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:52:08.626857 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe req-3bf62241-871f-4049-80d0-3abcda57b5d2 tempest-LiveMigrationTest-684237848 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:52:09.513281 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe req-3bf62241-871f-4049-80d0-3abcda57b5d2 tempest-LiveMigrationTest-684237848 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.884s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:52:09.517143 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe req-3bf62241-871f-4049-80d0-3abcda57b5d2 tempest-LiveMigrationTest-684237848 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dc75a1bd-8bf7-49a6-adb1-547033153d04', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'dc75a1bd-8bf7-49a6-adb1-547033153d04', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:52:09.594852 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe req-3bf62241-871f-4049-80d0-3abcda57b5d2 tempest-LiveMigrationTest-684237848 None] Connection info returned from driver {'name': 'volumes/volume-dc75a1bd-8bf7-49a6-adb1-547033153d04', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dc75a1bd-8bf7-49a6-adb1-547033153d04', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '49c6e9bc-ab4e-4778-93c9-9f1884f78eaa'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:52:09.677440 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe req-3bf62241-871f-4049-80d0-3abcda57b5d2 tempest-LiveMigrationTest-684237848 None] attachment_update completed successfully.
Oct 29 20:52:10.084897 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-1b6a6aac-fcfb-4845-a874-376392d185d5 req-f2cc339c-80c4-47f5-8663-bd7bb48bd50a tempest-TaggedBootDevicesTest-1807794048 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:52:11.765788 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-1b6a6aac-fcfb-4845-a874-376392d185d5 req-f2cc339c-80c4-47f5-8663-bd7bb48bd50a tempest-TaggedBootDevicesTest-1807794048 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.680s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:52:11.766514 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-1b6a6aac-fcfb-4845-a874-376392d185d5 req-f2cc339c-80c4-47f5-8663-bd7bb48bd50a tempest-TaggedBootDevicesTest-1807794048 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-336b3749-7436-45c4-b9f6-b8dd40a60951', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '336b3749-7436-45c4-b9f6-b8dd40a60951', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:52:11.845037 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-1b6a6aac-fcfb-4845-a874-376392d185d5 req-f2cc339c-80c4-47f5-8663-bd7bb48bd50a tempest-TaggedBootDevicesTest-1807794048 None] Connection info returned from driver {'name': 'volumes/volume-336b3749-7436-45c4-b9f6-b8dd40a60951', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '336b3749-7436-45c4-b9f6-b8dd40a60951', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8a0fb313-24de-4b63-8c23-7b568f7fd80a'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:52:11.980614 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-1b6a6aac-fcfb-4845-a874-376392d185d5 req-f2cc339c-80c4-47f5-8663-bd7bb48bd50a tempest-TaggedBootDevicesTest-1807794048 None] attachment_update completed successfully.
Oct 29 20:52:13.571134 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-1b6a6aac-fcfb-4845-a874-376392d185d5 req-0f86290d-e8da-4f40-8eee-84798b7bda20 tempest-TaggedBootDevicesTest-1807794048 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:52:14.489714 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-1b6a6aac-fcfb-4845-a874-376392d185d5 req-0f86290d-e8da-4f40-8eee-84798b7bda20 tempest-TaggedBootDevicesTest-1807794048 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.918s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:52:14.490549 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-1b6a6aac-fcfb-4845-a874-376392d185d5 req-0f86290d-e8da-4f40-8eee-84798b7bda20 tempest-TaggedBootDevicesTest-1807794048 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2f4a8a96-dc7e-47f8-b92d-9dd0700c950a', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '2f4a8a96-dc7e-47f8-b92d-9dd0700c950a', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:52:14.538067 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-1b6a6aac-fcfb-4845-a874-376392d185d5 req-0f86290d-e8da-4f40-8eee-84798b7bda20 tempest-TaggedBootDevicesTest-1807794048 None] Connection info returned from driver {'name': 'volumes/volume-2f4a8a96-dc7e-47f8-b92d-9dd0700c950a', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2f4a8a96-dc7e-47f8-b92d-9dd0700c950a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '484df115-d588-4ee3-84a8-0fa2091f4669'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:52:14.654666 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-1b6a6aac-fcfb-4845-a874-376392d185d5 req-0f86290d-e8da-4f40-8eee-84798b7bda20 tempest-TaggedBootDevicesTest-1807794048 None] attachment_update completed successfully.
Oct 29 20:52:15.258909 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-1b6a6aac-fcfb-4845-a874-376392d185d5 req-7385ae4a-ef60-40bb-8082-2f63d883840a tempest-TaggedBootDevicesTest-1807794048 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:52:16.401154 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-1b6a6aac-fcfb-4845-a874-376392d185d5 req-7385ae4a-ef60-40bb-8082-2f63d883840a tempest-TaggedBootDevicesTest-1807794048 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.142s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:52:16.403518 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-1b6a6aac-fcfb-4845-a874-376392d185d5 req-7385ae4a-ef60-40bb-8082-2f63d883840a tempest-TaggedBootDevicesTest-1807794048 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-56ccb44a-a3fa-40da-ab2a-b3e0884aaba6', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '56ccb44a-a3fa-40da-ab2a-b3e0884aaba6', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:52:16.453581 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-1b6a6aac-fcfb-4845-a874-376392d185d5 req-7385ae4a-ef60-40bb-8082-2f63d883840a tempest-TaggedBootDevicesTest-1807794048 None] Connection info returned from driver {'name': 'volumes/volume-56ccb44a-a3fa-40da-ab2a-b3e0884aaba6', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '56ccb44a-a3fa-40da-ab2a-b3e0884aaba6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ada23fcc-0cd2-4b9b-ab51-393ce532973b'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:52:16.544503 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-1b6a6aac-fcfb-4845-a874-376392d185d5 req-7385ae4a-ef60-40bb-8082-2f63d883840a tempest-TaggedBootDevicesTest-1807794048 None] attachment_update completed successfully.
Oct 29 20:52:30.968244 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe req-ef05180e-6375-45c3-ab7a-9dc131692f2d tempest-LiveMigrationTest-684237848 None] Terminate volume connection completed successfully.
Oct 29 20:52:30.968924 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-5d040a1a-08d1-4f27-9e01-c9bbeb0cf6fe req-ef05180e-6375-45c3-ab7a-9dc131692f2d tempest-LiveMigrationTest-684237848 None] Deleting attachment 6091f033-32ab-46b0-ab97-45cc04db2362. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 20:52:41.721612 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=47,cinder:UPDATE=6 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:52:41.722713 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=55,cinder:UPDATE=10 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:52:50.104394 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-9a11d36c-2916-4c95-a9df-4979da13a1c7 req-f81a2aad-4965-4ef7-a296-67d68e944c33 tempest-LiveMigrationTest-2002133718 None] Terminate volume connection completed successfully.
Oct 29 20:52:50.105939 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-9a11d36c-2916-4c95-a9df-4979da13a1c7 req-f81a2aad-4965-4ef7-a296-67d68e944c33 tempest-LiveMigrationTest-2002133718 None] Deleting attachment 49c6e9bc-ab4e-4778-93c9-9f1884f78eaa. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 20:52:51.836264 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 20:52:51.859867 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Flow 'volume_create_manager' (932fb7f3-0459-45d0-ad68-20e8f0e215ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:52:51.866850 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124ea4b3-c144-4389-ac4c-b45e3e00dcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:52:51.884669 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124ea4b3-c144-4389-ac4c-b45e3e00dcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T20:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-675695405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2a8a70f6-4db6-4c78-9864-0595400e6ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d373d98fd667430fac145e2e63249419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T20:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T20:52:52Z,use_quota=True,user_id='869b7117eab8443e9cbb52400b875ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:52:51.890477 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06c3036-b0a1-4a6c-a6ba-b980b29102d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:52:51.894558 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06c3036-b0a1-4a6c-a6ba-b980b29102d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:52:51.899750 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490bc0ba-e71f-4cf9-9c51-904ebe24cf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:52:51.992815 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490bc0ba-e71f-4cf9-9c51-904ebe24cf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a8a70f6-4db6-4c78-9864-0595400e6ea2', 'volume_name': 'volume-2a8a70f6-4db6-4c78-9864-0595400e6ea2', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9350478b20>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:52:51.997986 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21cdefd-b32a-40f6-a507-1ed1bd5dbe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:52:52.001940 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21cdefd-b32a-40f6-a507-1ed1bd5dbe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:52:52.007163 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277fffeb-5f58-4e52-97b8-7eebae1a2137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:52:52.008384 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Volume 2a8a70f6-4db6-4c78-9864-0595400e6ea2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a8a70f6-4db6-4c78-9864-0595400e6ea2', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9350478b20>}
Oct 29 20:52:52.009249 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Cloning 2a8a70f6-4db6-4c78-9864-0595400e6ea2 from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 20:52:52.010167 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 20:52:52.020687 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 20:52:52.031242 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 20, 52, 52, 25368)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 20:52:52.031775 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 20:52:52.032218 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Found cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 29 20:52:52.036354 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 20:52:52.037066 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 20:52:52.043190 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 20, 52, 52, 40719)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 20:52:52.043889 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 20:52:52.044279 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Creating from source image-volume fbe0dd2e-351a-4779-844d-3c66baf14939 {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 29 20:52:52.056896 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:52:52.124295 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] creating snapshot='volume-2a8a70f6-4db6-4c78-9864-0595400e6ea2.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 20:52:52.874912 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] cloning 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939@volume-2a8a70f6-4db6-4c78-9864-0595400e6ea2.clone_snap' to 'volume-2a8a70f6-4db6-4c78-9864-0595400e6ea2' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 20:52:53.074731 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 20:52:53.075987 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 20:52:53.076383 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 20:52:53.115881 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 20:52:53.117061 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Marking volume 2a8a70f6-4db6-4c78-9864-0595400e6ea2 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 20:52:53.126793 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to 2a8a70f6-4db6-4c78-9864-0595400e6ea2. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 20:52:53.127413 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Creating volume glance metadata for volume 2a8a70f6-4db6-4c78-9864-0595400e6ea2 backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 20:52:53.274140 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277fffeb-5f58-4e52-97b8-7eebae1a2137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8a70f6-4db6-4c78-9864-0595400e6ea2', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9350478b20>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:52:53.286257 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53e80a4-849c-400e-b52f-ad7ecfb8a3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:52:53.305515 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Volume volume-2a8a70f6-4db6-4c78-9864-0595400e6ea2 (2a8a70f6-4db6-4c78-9864-0595400e6ea2): created successfully
Oct 29 20:52:53.309074 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53e80a4-849c-400e-b52f-ad7ecfb8a3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:52:53.314433 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Flow 'volume_create_manager' (932fb7f3-0459-45d0-ad68-20e8f0e215ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:52:53.336196 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-baab4e39-3c44-443c-abb5-891d7e8df797 tempest-LiveMigrationTest-2002133718 None] Created volume successfully.
Oct 29 20:52:58.727114 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-dea4362a-53de-4e17-8031-06a5bf7ce606 req-445f9b6c-87b2-4239-94dd-4665f9525fff tempest-LiveMigrationTest-2002133718 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:53:00.358238 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-dea4362a-53de-4e17-8031-06a5bf7ce606 req-445f9b6c-87b2-4239-94dd-4665f9525fff tempest-LiveMigrationTest-2002133718 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.632s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:53:00.359057 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-dea4362a-53de-4e17-8031-06a5bf7ce606 req-445f9b6c-87b2-4239-94dd-4665f9525fff tempest-LiveMigrationTest-2002133718 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2a8a70f6-4db6-4c78-9864-0595400e6ea2', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '2a8a70f6-4db6-4c78-9864-0595400e6ea2', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:53:00.411373 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-dea4362a-53de-4e17-8031-06a5bf7ce606 req-445f9b6c-87b2-4239-94dd-4665f9525fff tempest-LiveMigrationTest-2002133718 None] Connection info returned from driver {'name': 'volumes/volume-2a8a70f6-4db6-4c78-9864-0595400e6ea2', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2a8a70f6-4db6-4c78-9864-0595400e6ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c682d81e-7f08-456b-a844-1ca11bc0c20a'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:53:00.510974 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-dea4362a-53de-4e17-8031-06a5bf7ce606 req-445f9b6c-87b2-4239-94dd-4665f9525fff tempest-LiveMigrationTest-2002133718 None] attachment_update completed successfully.
Oct 29 20:53:01.364994 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:53:01.367184 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:53:01.429466 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:53:01.489112 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:53:11.720799 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=34,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:53:21.735477 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=32,cinder:UPDATE=8,cinder:INSERT=11 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:53:22.721069 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-a313d59e-f904-45c7-984c-fdc8041ee0eb req-7b034a04-dde9-44f6-b92f-9a913920f623 tempest-LiveMigrationTest-684237848 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:53:23.972744 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-a313d59e-f904-45c7-984c-fdc8041ee0eb req-7b034a04-dde9-44f6-b92f-9a913920f623 tempest-LiveMigrationTest-684237848 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.251s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:53:23.973573 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-a313d59e-f904-45c7-984c-fdc8041ee0eb req-7b034a04-dde9-44f6-b92f-9a913920f623 tempest-LiveMigrationTest-684237848 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2a8a70f6-4db6-4c78-9864-0595400e6ea2', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '2a8a70f6-4db6-4c78-9864-0595400e6ea2', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:53:24.012293 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-a313d59e-f904-45c7-984c-fdc8041ee0eb req-7b034a04-dde9-44f6-b92f-9a913920f623 tempest-LiveMigrationTest-684237848 None] Connection info returned from driver {'name': 'volumes/volume-2a8a70f6-4db6-4c78-9864-0595400e6ea2', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2a8a70f6-4db6-4c78-9864-0595400e6ea2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3f393423-03e7-4450-bb03-276ba120a31f'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:53:24.085897 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-a313d59e-f904-45c7-984c-fdc8041ee0eb req-7b034a04-dde9-44f6-b92f-9a913920f623 tempest-LiveMigrationTest-684237848 None] attachment_update completed successfully.
Oct 29 20:53:34.086750 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=15,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:53:35.191863 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-a313d59e-f904-45c7-984c-fdc8041ee0eb req-84d28947-ae7a-4f65-a6bc-1dd47d434dc4 tempest-LiveMigrationTest-684237848 None] Terminate volume connection completed successfully.
Oct 29 20:53:35.192588 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-a313d59e-f904-45c7-984c-fdc8041ee0eb req-84d28947-ae7a-4f65-a6bc-1dd47d434dc4 tempest-LiveMigrationTest-684237848 None] Deleting attachment c682d81e-7f08-456b-a844-1ca11bc0c20a. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 20:53:47.072988 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 req-17b30a6f-136e-4d96-b015-fed38b9d4113 tempest-LiveMigrationTest-2002133718 None] Terminate volume connection completed successfully.
Oct 29 20:53:47.077447 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 req-17b30a6f-136e-4d96-b015-fed38b9d4113 tempest-LiveMigrationTest-2002133718 None] Deleting attachment 3f393423-03e7-4450-bb03-276ba120a31f. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 20:53:47.603362 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 req-565055b2-98fd-4b96-a532-5d8de7566a88 tempest-LiveMigrationTest-2002133718 None] Acquiring lock "cinder-2a8a70f6-4db6-4c78-9864-0595400e6ea2-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 20:53:47.619778 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 req-565055b2-98fd-4b96-a532-5d8de7566a88 tempest-LiveMigrationTest-2002133718 None] Lock "cinder-2a8a70f6-4db6-4c78-9864-0595400e6ea2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 20:53:47.688996 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 req-565055b2-98fd-4b96-a532-5d8de7566a88 tempest-LiveMigrationTest-2002133718 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:53:47.884244 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 req-565055b2-98fd-4b96-a532-5d8de7566a88 tempest-LiveMigrationTest-2002133718 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 20:53:47.908889 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 req-565055b2-98fd-4b96-a532-5d8de7566a88 tempest-LiveMigrationTest-2002133718 None] deleting rbd volume volume-2a8a70f6-4db6-4c78-9864-0595400e6ea2 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 20:53:48.392710 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-068e8202-74ed-45ed-8e8c-603e44133a7e tempest-LiveMigrationTest-2002133718 None] Acquiring lock "cinder-dc75a1bd-8bf7-49a6-adb1-547033153d04-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 20:53:48.410324 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-068e8202-74ed-45ed-8e8c-603e44133a7e tempest-LiveMigrationTest-2002133718 None] Lock "cinder-dc75a1bd-8bf7-49a6-adb1-547033153d04-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 20:53:48.534039 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-068e8202-74ed-45ed-8e8c-603e44133a7e tempest-LiveMigrationTest-2002133718 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:53:48.687352 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-068e8202-74ed-45ed-8e8c-603e44133a7e tempest-LiveMigrationTest-2002133718 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 20:53:48.688084 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-068e8202-74ed-45ed-8e8c-603e44133a7e tempest-LiveMigrationTest-2002133718 None] Volume volume-dc75a1bd-8bf7-49a6-adb1-547033153d04 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 20:53:48.704312 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-068e8202-74ed-45ed-8e8c-603e44133a7e tempest-LiveMigrationTest-2002133718 None] deleting rbd volume volume-dc75a1bd-8bf7-49a6-adb1-547033153d04 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 20:53:48.706173 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 req-565055b2-98fd-4b96-a532-5d8de7566a88 tempest-LiveMigrationTest-2002133718 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 20:53:48.763681 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 req-565055b2-98fd-4b96-a532-5d8de7566a88 tempest-LiveMigrationTest-2002133718 None] deleting parent snapshot volume-2a8a70f6-4db6-4c78-9864-0595400e6ea2.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 20:53:49.974956 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-068e8202-74ed-45ed-8e8c-603e44133a7e tempest-LiveMigrationTest-2002133718 None] Created reservations ['34080c82-417f-428c-98c8-9d89ebc1b45e', '437257db-a5fc-467f-95f9-571bc53c8834', '7c07072b-af28-4bca-a044-5e0f03daf0b9', 'dd08ccad-05b8-48fd-84ab-efb1b33a5267'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 20:53:50.004142 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 req-565055b2-98fd-4b96-a532-5d8de7566a88 tempest-LiveMigrationTest-2002133718 None] Created reservations ['bd1c5ed5-0752-4bf2-b593-b8bc46ce2d62', '92be2a77-875d-46f0-8ebc-24edb8e89b1c', 'cdc1905f-f868-4d92-9388-27c8e26511ba', 'aa404382-1204-4900-a8b0-2ed5b3d028c9'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 20:53:50.203895 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 req-565055b2-98fd-4b96-a532-5d8de7566a88 tempest-LiveMigrationTest-2002133718 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:53:50.306957 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 req-565055b2-98fd-4b96-a532-5d8de7566a88 tempest-LiveMigrationTest-2002133718 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:53:50.422250 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 req-565055b2-98fd-4b96-a532-5d8de7566a88 tempest-LiveMigrationTest-2002133718 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:53:50.430494 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 req-565055b2-98fd-4b96-a532-5d8de7566a88 tempest-LiveMigrationTest-2002133718 None] Deleted volume successfully.
Oct 29 20:53:50.438159 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-068e8202-74ed-45ed-8e8c-603e44133a7e tempest-LiveMigrationTest-2002133718 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:53:50.557102 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-068e8202-74ed-45ed-8e8c-603e44133a7e tempest-LiveMigrationTest-2002133718 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:53:50.699119 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-068e8202-74ed-45ed-8e8c-603e44133a7e tempest-LiveMigrationTest-2002133718 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:53:50.715650 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-068e8202-74ed-45ed-8e8c-603e44133a7e tempest-LiveMigrationTest-2002133718 None] Deleted volume successfully.
Oct 29 20:53:50.733521 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-b1a47010-2a21-4f9a-b0ca-6dab1ce34921 req-565055b2-98fd-4b96-a532-5d8de7566a88 tempest-LiveMigrationTest-2002133718 None] Lock "cinder-2a8a70f6-4db6-4c78-9864-0595400e6ea2-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 20:53:50.775305 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-068e8202-74ed-45ed-8e8c-603e44133a7e tempest-LiveMigrationTest-2002133718 None] Lock "cinder-dc75a1bd-8bf7-49a6-adb1-547033153d04-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 20:54:01.371241 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:54:01.371974 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:54:01.470499 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:54:01.558768 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:54:01.736716 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=42,cinder:UPDATE=23,cinder:INSERT=5 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:54:11.730863 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=37,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:54:41.732106 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:54:51.735546 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:55:01.375895 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:55:01.376572 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:55:01.543166 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:55:01.656388 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:55:19.370482 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:55:19.386471 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 20:55:19.416997 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Flow 'volume_create_manager' (004f8fb1-877d-491c-8a28-58b087b56812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:55:19.426950 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0218ceae-dc38-48d1-84b0-0c62980812f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:19.463829 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0218ceae-dc38-48d1-84b0-0c62980812f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T20:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1452895755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f63b060b-36c0-43ae-9fa9-42a926d80cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22ac3c92da747c58302269fc6a028f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T20:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T20:55:19Z,use_quota=True,user_id='014a25f21b294a42986928e0a8df6cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:19.478475 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef54552-f66f-4971-a5d4-606f732f0a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:19.485800 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef54552-f66f-4971-a5d4-606f732f0a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:19.498383 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b1242b-9cee-4218-9314-26bdcd13d2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:19.644064 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b1242b-9cee-4218-9314-26bdcd13d2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f63b060b-36c0-43ae-9fa9-42a926d80cd7', 'volume_name': 'volume-f63b060b-36c0-43ae-9fa9-42a926d80cd7', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93468a3040>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:19.651432 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc329ff8-33b1-4c8e-aee9-519619845fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:19.657005 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc329ff8-33b1-4c8e-aee9-519619845fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:19.674023 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a760c99-2854-40e7-8161-9d34b34cb4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:19.676883 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Volume f63b060b-36c0-43ae-9fa9-42a926d80cd7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f63b060b-36c0-43ae-9fa9-42a926d80cd7', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93468a3040>}
Oct 29 20:55:19.680975 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Cloning f63b060b-36c0-43ae-9fa9-42a926d80cd7 from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 20:55:19.682552 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 20:55:19.709962 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.028s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 20:55:19.726031 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 20, 55, 19, 717364)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 20:55:19.726485 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 20:55:19.727091 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Found cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 29 20:55:19.733094 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 0.023s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 20:55:19.736629 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 20:55:19.749384 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 20, 55, 19, 743383)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 20:55:19.749855 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 20:55:19.751926 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Creating from source image-volume fbe0dd2e-351a-4779-844d-3c66baf14939 {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 29 20:55:19.799339 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:55:19.973514 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] creating snapshot='volume-f63b060b-36c0-43ae-9fa9-42a926d80cd7.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 20:55:20.516099 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] cloning 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939@volume-f63b060b-36c0-43ae-9fa9-42a926d80cd7.clone_snap' to 'volume-f63b060b-36c0-43ae-9fa9-42a926d80cd7' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 20:55:20.742798 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 20:55:20.746304 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 20:55:20.746978 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 20:55:20.786032 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 20:55:20.786949 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Marking volume f63b060b-36c0-43ae-9fa9-42a926d80cd7 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 20:55:20.805879 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to f63b060b-36c0-43ae-9fa9-42a926d80cd7. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 20:55:20.806545 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Creating volume glance metadata for volume f63b060b-36c0-43ae-9fa9-42a926d80cd7 backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 20:55:20.877423 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a760c99-2854-40e7-8161-9d34b34cb4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f63b060b-36c0-43ae-9fa9-42a926d80cd7', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93468a3040>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:20.882813 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34fb387-38e1-4042-a923-d1b7a403d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:20.892704 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Volume volume-f63b060b-36c0-43ae-9fa9-42a926d80cd7 (f63b060b-36c0-43ae-9fa9-42a926d80cd7): created successfully
Oct 29 20:55:20.899020 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34fb387-38e1-4042-a923-d1b7a403d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:20.906309 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Flow 'volume_create_manager' (004f8fb1-877d-491c-8a28-58b087b56812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:55:20.917676 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-ff4ec6e0-b50d-4c56-9083-0087959e36d0 tempest-TaggedBootDevicesTest_v242-1596127670 None] Created volume successfully.
Oct 29 20:55:22.122351 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 20:55:22.171502 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Flow 'volume_create_manager' (80c3b9d3-7a0c-4e1a-a91c-098dfcf3ac77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:55:22.179783 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b490b15-e907-47b7-9fc6-a848c105460c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:22.225425 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b490b15-e907-47b7-9fc6-a848c105460c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T20:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1975637341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ec673dab-2cf6-4dc2-b93f-219ee36ef531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22ac3c92da747c58302269fc6a028f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T20:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T20:55:22Z,use_quota=True,user_id='014a25f21b294a42986928e0a8df6cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:22.240356 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bba0208-9c32-4e02-b430-de8d1e37d34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:22.250752 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bba0208-9c32-4e02-b430-de8d1e37d34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:22.256639 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3a00a2-faee-42e7-bf6b-59b67113b365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:22.260658 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3a00a2-faee-42e7-bf6b-59b67113b365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec673dab-2cf6-4dc2-b93f-219ee36ef531', 'volume_name': 'volume-ec673dab-2cf6-4dc2-b93f-219ee36ef531', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:22.267070 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f75628e-6105-45f3-bdda-cbf011c035f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:22.271780 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f75628e-6105-45f3-bdda-cbf011c035f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:22.277644 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f5fd3c-53a8-43cb-9fbf-9adcda4a041d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:22.279216 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Volume ec673dab-2cf6-4dc2-b93f-219ee36ef531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec673dab-2cf6-4dc2-b93f-219ee36ef531', 'volume_size': 1}
Oct 29 20:55:22.279712 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] creating volume 'volume-ec673dab-2cf6-4dc2-b93f-219ee36ef531' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 20:55:22.280741 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:55:22.397179 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 20:55:22.397818 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 20:55:22.403205 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f5fd3c-53a8-43cb-9fbf-9adcda4a041d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec673dab-2cf6-4dc2-b93f-219ee36ef531', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:22.407819 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022992b4-322a-4245-babd-ad909260849a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:22.421088 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Volume volume-ec673dab-2cf6-4dc2-b93f-219ee36ef531 (ec673dab-2cf6-4dc2-b93f-219ee36ef531): created successfully
Oct 29 20:55:22.426003 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022992b4-322a-4245-babd-ad909260849a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:22.444971 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Flow 'volume_create_manager' (80c3b9d3-7a0c-4e1a-a91c-098dfcf3ac77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:55:22.455870 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f3475be6-4ac1-4bc8-8e8e-ad8825389647 tempest-TaggedBootDevicesTest_v242-1596127670 None] Created volume successfully.
Oct 29 20:55:23.445275 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 20:55:23.509036 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Flow 'volume_create_manager' (6065d1f0-259f-4236-b6a2-1ac6291f9773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:55:23.515974 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe3624f-44bc-44cc-978c-5981831f6609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:23.549985 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe3624f-44bc-44cc-978c-5981831f6609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T20:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-2102351280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3debad03-736d-4863-b27d-c2bed6ae1053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22ac3c92da747c58302269fc6a028f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T20:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T20:55:23Z,use_quota=True,user_id='014a25f21b294a42986928e0a8df6cfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:23.559493 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1950fe2-7875-4852-97b1-70a08cd9e218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:23.563837 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1950fe2-7875-4852-97b1-70a08cd9e218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:23.568964 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fbcbca-c1e9-42ec-be30-b7e829533d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:23.573853 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fbcbca-c1e9-42ec-be30-b7e829533d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3debad03-736d-4863-b27d-c2bed6ae1053', 'volume_name': 'volume-3debad03-736d-4863-b27d-c2bed6ae1053', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:23.578843 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b733f0ae-c30a-4a1c-8cce-c8388a3d73b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:23.583091 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b733f0ae-c30a-4a1c-8cce-c8388a3d73b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:23.587774 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8177fcbb-934a-4a5f-b28e-4eac47d7a524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:23.588926 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Volume 3debad03-736d-4863-b27d-c2bed6ae1053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3debad03-736d-4863-b27d-c2bed6ae1053', 'volume_size': 1}
Oct 29 20:55:23.589384 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] creating volume 'volume-3debad03-736d-4863-b27d-c2bed6ae1053' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 20:55:23.590142 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:55:23.725975 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 20:55:23.727345 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 20:55:23.731140 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8177fcbb-934a-4a5f-b28e-4eac47d7a524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3debad03-736d-4863-b27d-c2bed6ae1053', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:23.735944 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74155ddd-4211-45ef-9e7f-135bb7c7241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:55:23.746318 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Volume volume-3debad03-736d-4863-b27d-c2bed6ae1053 (3debad03-736d-4863-b27d-c2bed6ae1053): created successfully
Oct 29 20:55:23.750795 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74155ddd-4211-45ef-9e7f-135bb7c7241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:55:23.757973 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Flow 'volume_create_manager' (6065d1f0-259f-4236-b6a2-1ac6291f9773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:55:23.770825 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-046e5d4d-24e9-4fac-ab68-507e3c6244fc tempest-TaggedBootDevicesTest_v242-1596127670 None] Created volume successfully.
Oct 29 20:55:41.749857 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=28,cinder:UPDATE=12,cinder:INSERT=7,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:55:46.955723 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-a4d5a2a7-a349-4139-b6d6-272c5d429916 req-ea6eb907-0064-4e1c-b720-f92b7a361ff8 tempest-TaggedBootDevicesTest_v242-1596127670 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:55:48.411513 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-a4d5a2a7-a349-4139-b6d6-272c5d429916 req-ea6eb907-0064-4e1c-b720-f92b7a361ff8 tempest-TaggedBootDevicesTest_v242-1596127670 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.455s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:55:48.412359 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-a4d5a2a7-a349-4139-b6d6-272c5d429916 req-ea6eb907-0064-4e1c-b720-f92b7a361ff8 tempest-TaggedBootDevicesTest_v242-1596127670 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f63b060b-36c0-43ae-9fa9-42a926d80cd7', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'f63b060b-36c0-43ae-9fa9-42a926d80cd7', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:55:48.511416 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-a4d5a2a7-a349-4139-b6d6-272c5d429916 req-ea6eb907-0064-4e1c-b720-f92b7a361ff8 tempest-TaggedBootDevicesTest_v242-1596127670 None] Connection info returned from driver {'name': 'volumes/volume-f63b060b-36c0-43ae-9fa9-42a926d80cd7', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f63b060b-36c0-43ae-9fa9-42a926d80cd7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'af8baa56-2eca-4552-866b-d0687ed8f411'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:55:48.603494 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-a4d5a2a7-a349-4139-b6d6-272c5d429916 req-ea6eb907-0064-4e1c-b720-f92b7a361ff8 tempest-TaggedBootDevicesTest_v242-1596127670 None] attachment_update completed successfully.
Oct 29 20:55:49.364895 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-a4d5a2a7-a349-4139-b6d6-272c5d429916 req-6e5aab50-a94d-4d51-9743-c5916269ae9c tempest-TaggedBootDevicesTest_v242-1596127670 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:55:50.617049 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-a4d5a2a7-a349-4139-b6d6-272c5d429916 req-6e5aab50-a94d-4d51-9743-c5916269ae9c tempest-TaggedBootDevicesTest_v242-1596127670 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.252s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:55:50.617987 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-a4d5a2a7-a349-4139-b6d6-272c5d429916 req-6e5aab50-a94d-4d51-9743-c5916269ae9c tempest-TaggedBootDevicesTest_v242-1596127670 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ec673dab-2cf6-4dc2-b93f-219ee36ef531', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'ec673dab-2cf6-4dc2-b93f-219ee36ef531', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:55:50.627129 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=41,cinder:UPDATE=5,cinder:INSERT=5,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:55:50.699857 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-a4d5a2a7-a349-4139-b6d6-272c5d429916 req-6e5aab50-a94d-4d51-9743-c5916269ae9c tempest-TaggedBootDevicesTest_v242-1596127670 None] Connection info returned from driver {'name': 'volumes/volume-ec673dab-2cf6-4dc2-b93f-219ee36ef531', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ec673dab-2cf6-4dc2-b93f-219ee36ef531', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4d743185-b9bc-407c-936a-046333658f39'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:55:50.862767 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-a4d5a2a7-a349-4139-b6d6-272c5d429916 req-6e5aab50-a94d-4d51-9743-c5916269ae9c tempest-TaggedBootDevicesTest_v242-1596127670 None] attachment_update completed successfully.
Oct 29 20:55:51.506873 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-a4d5a2a7-a349-4139-b6d6-272c5d429916 req-33ec55a8-aea4-41a6-a913-63934acabfe9 tempest-TaggedBootDevicesTest_v242-1596127670 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:55:52.685076 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-a4d5a2a7-a349-4139-b6d6-272c5d429916 req-33ec55a8-aea4-41a6-a913-63934acabfe9 tempest-TaggedBootDevicesTest_v242-1596127670 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.179s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:55:52.686881 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-a4d5a2a7-a349-4139-b6d6-272c5d429916 req-33ec55a8-aea4-41a6-a913-63934acabfe9 tempest-TaggedBootDevicesTest_v242-1596127670 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3debad03-736d-4863-b27d-c2bed6ae1053', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '3debad03-736d-4863-b27d-c2bed6ae1053', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:55:52.727060 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-a4d5a2a7-a349-4139-b6d6-272c5d429916 req-33ec55a8-aea4-41a6-a913-63934acabfe9 tempest-TaggedBootDevicesTest_v242-1596127670 None] Connection info returned from driver {'name': 'volumes/volume-3debad03-736d-4863-b27d-c2bed6ae1053', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3debad03-736d-4863-b27d-c2bed6ae1053', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7a43d297-e5ff-4113-81e2-73a55b8f87d9'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:55:52.791053 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-a4d5a2a7-a349-4139-b6d6-272c5d429916 req-33ec55a8-aea4-41a6-a913-63934acabfe9 tempest-TaggedBootDevicesTest_v242-1596127670 None] attachment_update completed successfully.
Oct 29 20:56:01.372531 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:56:01.373179 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:56:01.432580 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:56:01.543369 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:56:05.636320 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 20:56:05.666377 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Flow 'volume_create_manager' (1a0a61a0-a33c-43ac-843f-0d95f8a3abae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:56:05.674371 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d89b81-a40c-4d53-ae62-24427f69fd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:05.751409 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d89b81-a40c-4d53-ae62-24427f69fd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T20:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-1145208561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9f151151-e569-44ac-bce7-7e64e381bfb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a637980654ed411a96672f36bab6214a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T20:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T20:56:06Z,use_quota=True,user_id='d3e4d267d3b344928a2ca0a6e79eadb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:05.788359 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396e0679-b577-4e13-850e-62ca36baf0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:05.804217 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (396e0679-b577-4e13-850e-62ca36baf0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:05.830674 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76df762e-9700-4533-81a0-e6030b2c1672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:05.847729 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76df762e-9700-4533-81a0-e6030b2c1672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f151151-e569-44ac-bce7-7e64e381bfb2', 'volume_name': 'volume-9f151151-e569-44ac-bce7-7e64e381bfb2', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:05.866714 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85729c1e-1b0a-4310-aeba-6d398c20ee30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:05.926973 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85729c1e-1b0a-4310-aeba-6d398c20ee30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:05.956257 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366aa5cf-347f-4212-bfb7-4ddcbbd06f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:05.961961 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Volume 9f151151-e569-44ac-bce7-7e64e381bfb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f151151-e569-44ac-bce7-7e64e381bfb2', 'volume_size': 1}
Oct 29 20:56:05.965209 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] creating volume 'volume-9f151151-e569-44ac-bce7-7e64e381bfb2' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 20:56:05.970718 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:56:06.134815 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 20:56:06.135661 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 20:56:06.140900 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366aa5cf-347f-4212-bfb7-4ddcbbd06f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f151151-e569-44ac-bce7-7e64e381bfb2', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:06.154873 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced49f0e-4f28-4fdd-b7fe-718b92e3840f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:06.196389 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Volume volume-9f151151-e569-44ac-bce7-7e64e381bfb2 (9f151151-e569-44ac-bce7-7e64e381bfb2): created successfully
Oct 29 20:56:06.202458 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ced49f0e-4f28-4fdd-b7fe-718b92e3840f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:06.227286 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Flow 'volume_create_manager' (1a0a61a0-a33c-43ac-843f-0d95f8a3abae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:56:06.260730 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1d6304ae-2fa4-4f43-b7c6-68df8e08eb77 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Created volume successfully.
Oct 29 20:56:07.498860 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-2b25f3b8-47e2-4952-8881-166a90b354aa req-67c22c1a-6b8a-4b75-b1ae-07efb9d9fc23 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:56:09.167675 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-2b25f3b8-47e2-4952-8881-166a90b354aa req-67c22c1a-6b8a-4b75-b1ae-07efb9d9fc23 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.668s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:56:09.168603 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-2b25f3b8-47e2-4952-8881-166a90b354aa req-67c22c1a-6b8a-4b75-b1ae-07efb9d9fc23 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9f151151-e569-44ac-bce7-7e64e381bfb2', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '9f151151-e569-44ac-bce7-7e64e381bfb2', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:56:09.215431 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-2b25f3b8-47e2-4952-8881-166a90b354aa req-67c22c1a-6b8a-4b75-b1ae-07efb9d9fc23 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Connection info returned from driver {'name': 'volumes/volume-9f151151-e569-44ac-bce7-7e64e381bfb2', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9f151151-e569-44ac-bce7-7e64e381bfb2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '367c399e-e19e-48db-9d12-7c9ce26cb3b8'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:56:09.329653 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-2b25f3b8-47e2-4952-8881-166a90b354aa req-67c22c1a-6b8a-4b75-b1ae-07efb9d9fc23 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] attachment_update completed successfully.
Oct 29 20:56:19.833283 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=57,cinder:UPDATE=13 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:56:19.845075 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 req-e647a008-25a5-4ced-8367-38f8a4ff478e tempest-LiveAutoBlockMigrationV225Test-798039788 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:56:21.654925 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 req-e647a008-25a5-4ced-8367-38f8a4ff478e tempest-LiveAutoBlockMigrationV225Test-798039788 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.809s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:56:21.655614 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 req-e647a008-25a5-4ced-8367-38f8a4ff478e tempest-LiveAutoBlockMigrationV225Test-798039788 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9f151151-e569-44ac-bce7-7e64e381bfb2', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '9f151151-e569-44ac-bce7-7e64e381bfb2', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:56:21.677727 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=35,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:56:21.765386 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 req-e647a008-25a5-4ced-8367-38f8a4ff478e tempest-LiveAutoBlockMigrationV225Test-798039788 None] Connection info returned from driver {'name': 'volumes/volume-9f151151-e569-44ac-bce7-7e64e381bfb2', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9f151151-e569-44ac-bce7-7e64e381bfb2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '45641cf1-016f-48af-9e62-bc365ecd813b'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:56:21.887329 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 req-e647a008-25a5-4ced-8367-38f8a4ff478e tempest-LiveAutoBlockMigrationV225Test-798039788 None] attachment_update completed successfully.
Oct 29 20:56:32.483460 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 req-481fea89-ab31-4f54-982c-d65a43520f0a tempest-LiveAutoBlockMigrationV225Test-798039788 None] Terminate volume connection completed successfully.
Oct 29 20:56:32.484189 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-2bd9cf19-32f2-41fc-b5ec-6f1be983dde9 req-481fea89-ab31-4f54-982c-d65a43520f0a tempest-LiveAutoBlockMigrationV225Test-798039788 None] Deleting attachment 367c399e-e19e-48db-9d12-7c9ce26cb3b8. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 20:56:42.483974 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:56:43.990597 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-6f850470-2957-4d73-97d5-becb312e00a1 req-0b32685c-909f-4954-895a-4ddae6ed4629 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Terminate volume connection completed successfully.
Oct 29 20:56:43.991284 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-6f850470-2957-4d73-97d5-becb312e00a1 req-0b32685c-909f-4954-895a-4ddae6ed4629 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Deleting attachment 45641cf1-016f-48af-9e62-bc365ecd813b. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 20:56:45.585227 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 20:56:45.663858 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Flow 'volume_create_manager' (08659fef-2efc-4a7f-a10f-6a1b0f8810da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:56:45.683544 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea9361a-6456-4882-8c80-b40d38107cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:45.724879 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea9361a-6456-4882-8c80-b40d38107cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T20:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1107708954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fd3221f7-f74c-42c3-adb5-0153e2927c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a637980654ed411a96672f36bab6214a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T20:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T20:56:45Z,use_quota=True,user_id='d3e4d267d3b344928a2ca0a6e79eadb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:45.730647 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bec014-01d9-4748-b6d8-d1f9b19ba635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:45.740509 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bec014-01d9-4748-b6d8-d1f9b19ba635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:45.753946 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f586c1b-9595-4f0a-aee1-78c544066bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:45.974431 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f586c1b-9595-4f0a-aee1-78c544066bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd3221f7-f74c-42c3-adb5-0153e2927c11', 'volume_name': 'volume-fd3221f7-f74c-42c3-adb5-0153e2927c11', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9350472fa0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:45.996071 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df901a57-7cda-4000-a24d-191c994d5439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:46.003617 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df901a57-7cda-4000-a24d-191c994d5439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:46.019343 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e0454a-5978-4f42-b3cb-4ac771091478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:46.024188 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Volume fd3221f7-f74c-42c3-adb5-0153e2927c11: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd3221f7-f74c-42c3-adb5-0153e2927c11', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9350472fa0>}
Oct 29 20:56:46.050041 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Cloning fd3221f7-f74c-42c3-adb5-0153e2927c11 from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 20:56:46.051162 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 20:56:46.096302 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.045s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 20:56:46.131353 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 20, 56, 46, 114700)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 20:56:46.132954 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 20:56:46.137833 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Found cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 29 20:56:46.152593 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 0.057s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 20:56:46.153144 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 20:56:46.173374 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 20, 56, 46, 165880)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 20:56:46.173833 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 20:56:46.175615 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Creating from source image-volume fbe0dd2e-351a-4779-844d-3c66baf14939 {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 29 20:56:46.217426 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:56:46.350101 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] creating snapshot='volume-fd3221f7-f74c-42c3-adb5-0153e2927c11.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 20:56:46.582955 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] cloning 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939@volume-fd3221f7-f74c-42c3-adb5-0153e2927c11.clone_snap' to 'volume-fd3221f7-f74c-42c3-adb5-0153e2927c11' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 20:56:46.802973 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 20:56:46.804012 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 20:56:46.804624 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 20:56:46.860864 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 20:56:46.863265 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Marking volume fd3221f7-f74c-42c3-adb5-0153e2927c11 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 20:56:46.876952 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to fd3221f7-f74c-42c3-adb5-0153e2927c11. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 20:56:46.878022 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Creating volume glance metadata for volume fd3221f7-f74c-42c3-adb5-0153e2927c11 backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 20:56:47.057845 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e0454a-5978-4f42-b3cb-4ac771091478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3221f7-f74c-42c3-adb5-0153e2927c11', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9350472fa0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:47.081675 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179be672-c58c-4813-8f18-3daeab3f6b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:47.108389 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Volume volume-fd3221f7-f74c-42c3-adb5-0153e2927c11 (fd3221f7-f74c-42c3-adb5-0153e2927c11): created successfully
Oct 29 20:56:47.115343 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179be672-c58c-4813-8f18-3daeab3f6b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:47.120769 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Flow 'volume_create_manager' (08659fef-2efc-4a7f-a10f-6a1b0f8810da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:56:47.139477 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-796c381b-5867-467f-8100-95c5196bb9e4 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Created volume successfully.
Oct 29 20:56:47.192120 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 20:56:47.213082 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Flow 'volume_create_manager' (e5b61017-1abd-4a87-9ca1-110e13ea459e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:56:47.219609 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b75c658-8070-4f89-a4c1-260bdf3b3453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:47.237955 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b75c658-8070-4f89-a4c1-260bdf3b3453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T20:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1472812166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=62815267-2fed-492c-86da-0f37a8b4198f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2137acee38429eaf0246a35c495060',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T20:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T20:56:47Z,use_quota=True,user_id='95819256e6c74cf182933860544dae77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:47.243632 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df20416-0f8d-466b-9f5b-41510ededa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:47.248261 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df20416-0f8d-466b-9f5b-41510ededa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:47.254050 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97643d3-7b9b-4047-8eb3-b1d0fc1d5087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:47.258317 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97643d3-7b9b-4047-8eb3-b1d0fc1d5087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62815267-2fed-492c-86da-0f37a8b4198f', 'volume_name': 'volume-62815267-2fed-492c-86da-0f37a8b4198f', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:47.263198 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2934d250-9233-4118-bb4e-a54d8c5fff60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:47.267240 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2934d250-9233-4118-bb4e-a54d8c5fff60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:47.271899 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4158586d-a753-43a3-8f20-1d323dbf53b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:47.272983 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Volume 62815267-2fed-492c-86da-0f37a8b4198f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62815267-2fed-492c-86da-0f37a8b4198f', 'volume_size': 1}
Oct 29 20:56:47.273386 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] creating volume 'volume-62815267-2fed-492c-86da-0f37a8b4198f' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 20:56:47.274078 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:56:47.342263 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 20:56:47.343069 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 20:56:47.348297 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4158586d-a753-43a3-8f20-1d323dbf53b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62815267-2fed-492c-86da-0f37a8b4198f', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:47.354859 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6758c9d1-8048-470f-ac92-80aa1202e307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 20:56:47.365288 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Volume volume-62815267-2fed-492c-86da-0f37a8b4198f (62815267-2fed-492c-86da-0f37a8b4198f): created successfully
Oct 29 20:56:47.369665 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6758c9d1-8048-470f-ac92-80aa1202e307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 20:56:47.376035 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Flow 'volume_create_manager' (e5b61017-1abd-4a87-9ca1-110e13ea459e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 20:56:47.387693 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-bd0032c2-f346-48af-8205-c1b420ee2fbd tempest-AttachSCSIVolumeTestJSON-1701230677 None] Created volume successfully.
Oct 29 20:56:50.229480 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=45,cinder:UPDATE=5,cinder:INSERT=12,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:56:50.258240 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-dca6ab24-c304-4a7f-85fb-6e38dfb8e177 req-0eefe5d8-78bc-410b-a663-a91d0b4cdd16 tempest-AttachSCSIVolumeTestJSON-1701230677 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:56:52.012072 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-dca6ab24-c304-4a7f-85fb-6e38dfb8e177 req-0eefe5d8-78bc-410b-a663-a91d0b4cdd16 tempest-AttachSCSIVolumeTestJSON-1701230677 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.758s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:56:52.013093 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-dca6ab24-c304-4a7f-85fb-6e38dfb8e177 req-0eefe5d8-78bc-410b-a663-a91d0b4cdd16 tempest-AttachSCSIVolumeTestJSON-1701230677 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-62815267-2fed-492c-86da-0f37a8b4198f', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '62815267-2fed-492c-86da-0f37a8b4198f', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:56:52.061121 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-9010555a-1c06-452f-94bc-7191e4036a8c req-56fa3ac3-cd65-4345-88a4-08ad69e037de tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:56:52.088215 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-dca6ab24-c304-4a7f-85fb-6e38dfb8e177 req-0eefe5d8-78bc-410b-a663-a91d0b4cdd16 tempest-AttachSCSIVolumeTestJSON-1701230677 None] Connection info returned from driver {'name': 'volumes/volume-62815267-2fed-492c-86da-0f37a8b4198f', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '62815267-2fed-492c-86da-0f37a8b4198f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '44e2f036-ef38-427c-96d9-d9855edb4eda'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:56:52.236441 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-dca6ab24-c304-4a7f-85fb-6e38dfb8e177 req-0eefe5d8-78bc-410b-a663-a91d0b4cdd16 tempest-AttachSCSIVolumeTestJSON-1701230677 None] attachment_update completed successfully.
Oct 29 20:56:53.172731 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-9010555a-1c06-452f-94bc-7191e4036a8c req-56fa3ac3-cd65-4345-88a4-08ad69e037de tempest-LiveAutoBlockMigrationV225Test-1817678524 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.112s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:56:53.175468 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-9010555a-1c06-452f-94bc-7191e4036a8c req-56fa3ac3-cd65-4345-88a4-08ad69e037de tempest-LiveAutoBlockMigrationV225Test-1817678524 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fd3221f7-f74c-42c3-adb5-0153e2927c11', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'fd3221f7-f74c-42c3-adb5-0153e2927c11', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:56:53.224010 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-9010555a-1c06-452f-94bc-7191e4036a8c req-56fa3ac3-cd65-4345-88a4-08ad69e037de tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Connection info returned from driver {'name': 'volumes/volume-fd3221f7-f74c-42c3-adb5-0153e2927c11', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fd3221f7-f74c-42c3-adb5-0153e2927c11', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0261be78-73e0-4251-96fb-55ff663b7c22'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:56:53.331166 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-9010555a-1c06-452f-94bc-7191e4036a8c req-56fa3ac3-cd65-4345-88a4-08ad69e037de tempest-LiveAutoBlockMigrationV225Test-1817678524 None] attachment_update completed successfully.
Oct 29 20:56:56.936665 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-86f88eb0-ba48-4710-add3-065f8c53fa82 req-0b8c413c-cd41-4d59-a1da-77a89ac2bd21 tempest-AttachSCSIVolumeTestJSON-1701230677 None] Terminate volume connection completed successfully.
Oct 29 20:56:56.937309 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-86f88eb0-ba48-4710-add3-065f8c53fa82 req-0b8c413c-cd41-4d59-a1da-77a89ac2bd21 tempest-AttachSCSIVolumeTestJSON-1701230677 None] Deleting attachment 44e2f036-ef38-427c-96d9-d9855edb4eda. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 20:57:00.343417 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-d740a334-2018-4579-a756-38c06ad5467a req-675045ad-bee2-477b-b177-912c726689b3 tempest-TaggedBootDevicesTest-1807794048 None] Terminate volume connection completed successfully.
Oct 29 20:57:00.344054 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-d740a334-2018-4579-a756-38c06ad5467a req-675045ad-bee2-477b-b177-912c726689b3 tempest-TaggedBootDevicesTest-1807794048 None] Deleting attachment 8a0fb313-24de-4b63-8c23-7b568f7fd80a. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 20:57:00.553985 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-d740a334-2018-4579-a756-38c06ad5467a req-14675e89-1da2-42bb-96e0-aaafc2b1411c tempest-TaggedBootDevicesTest-1807794048 None] Terminate volume connection completed successfully.
Oct 29 20:57:00.554409 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-d740a334-2018-4579-a756-38c06ad5467a req-14675e89-1da2-42bb-96e0-aaafc2b1411c tempest-TaggedBootDevicesTest-1807794048 None] Deleting attachment 484df115-d588-4ee3-84a8-0fa2091f4669. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 20:57:00.820550 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-d740a334-2018-4579-a756-38c06ad5467a req-eabb97f5-e936-45f1-a37a-19b29e82e5ef tempest-TaggedBootDevicesTest-1807794048 None] Terminate volume connection completed successfully.
Oct 29 20:57:00.822327 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-d740a334-2018-4579-a756-38c06ad5467a req-eabb97f5-e936-45f1-a37a-19b29e82e5ef tempest-TaggedBootDevicesTest-1807794048 None] Deleting attachment ada23fcc-0cd2-4b9b-ab51-393ce532973b. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 20:57:01.371097 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:57:01.372911 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:01.493556 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:01.641929 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:57:10.822552 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=45,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:57:11.394881 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ac1a3acb-4eb2-48f8-99a0-bc85d321d0f0 tempest-AttachSCSIVolumeTestJSON-1701230677 None] Acquiring lock "cinder-62815267-2fed-492c-86da-0f37a8b4198f-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 20:57:11.464626 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ac1a3acb-4eb2-48f8-99a0-bc85d321d0f0 tempest-AttachSCSIVolumeTestJSON-1701230677 None] Lock "cinder-62815267-2fed-492c-86da-0f37a8b4198f-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 20:57:11.587412 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ac1a3acb-4eb2-48f8-99a0-bc85d321d0f0 tempest-AttachSCSIVolumeTestJSON-1701230677 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:11.701838 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ac1a3acb-4eb2-48f8-99a0-bc85d321d0f0 tempest-AttachSCSIVolumeTestJSON-1701230677 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 20:57:11.702300 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ac1a3acb-4eb2-48f8-99a0-bc85d321d0f0 tempest-AttachSCSIVolumeTestJSON-1701230677 None] Volume volume-62815267-2fed-492c-86da-0f37a8b4198f is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 20:57:11.711759 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ac1a3acb-4eb2-48f8-99a0-bc85d321d0f0 tempest-AttachSCSIVolumeTestJSON-1701230677 None] deleting rbd volume volume-62815267-2fed-492c-86da-0f37a8b4198f {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 20:57:12.293748 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-ac1a3acb-4eb2-48f8-99a0-bc85d321d0f0 tempest-AttachSCSIVolumeTestJSON-1701230677 None] Created reservations ['faaea017-0df4-4d45-9f3b-220d564d5845', 'a6cba3e8-431b-40f7-80b0-b625b2ee01b9', '3d286fa6-c843-42cb-a002-b3fbc7bfaf00', '4618552e-980e-4f29-849c-0812d5b07d5b'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 20:57:12.438868 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ac1a3acb-4eb2-48f8-99a0-bc85d321d0f0 tempest-AttachSCSIVolumeTestJSON-1701230677 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:12.515295 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ac1a3acb-4eb2-48f8-99a0-bc85d321d0f0 tempest-AttachSCSIVolumeTestJSON-1701230677 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:12.616070 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-ac1a3acb-4eb2-48f8-99a0-bc85d321d0f0 tempest-AttachSCSIVolumeTestJSON-1701230677 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:57:12.628332 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-ac1a3acb-4eb2-48f8-99a0-bc85d321d0f0 tempest-AttachSCSIVolumeTestJSON-1701230677 None] Deleted volume successfully.
Oct 29 20:57:12.656946 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ac1a3acb-4eb2-48f8-99a0-bc85d321d0f0 tempest-AttachSCSIVolumeTestJSON-1701230677 None] Lock "cinder-62815267-2fed-492c-86da-0f37a8b4198f-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 20:57:17.341385 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-8a549aca-6f40-428b-83de-9fcd5262b7c3 tempest-TaggedBootDevicesTest-1807794048 None] Acquiring lock "cinder-56ccb44a-a3fa-40da-ab2a-b3e0884aaba6-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 20:57:17.365730 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-8a549aca-6f40-428b-83de-9fcd5262b7c3 tempest-TaggedBootDevicesTest-1807794048 None] Lock "cinder-56ccb44a-a3fa-40da-ab2a-b3e0884aaba6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 20:57:17.438021 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8a549aca-6f40-428b-83de-9fcd5262b7c3 tempest-TaggedBootDevicesTest-1807794048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:17.504782 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8a549aca-6f40-428b-83de-9fcd5262b7c3 tempest-TaggedBootDevicesTest-1807794048 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 20:57:17.505275 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8a549aca-6f40-428b-83de-9fcd5262b7c3 tempest-TaggedBootDevicesTest-1807794048 None] Volume volume-56ccb44a-a3fa-40da-ab2a-b3e0884aaba6 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 20:57:17.531215 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8a549aca-6f40-428b-83de-9fcd5262b7c3 tempest-TaggedBootDevicesTest-1807794048 None] deleting rbd volume volume-56ccb44a-a3fa-40da-ab2a-b3e0884aaba6 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 20:57:18.207785 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-8a549aca-6f40-428b-83de-9fcd5262b7c3 tempest-TaggedBootDevicesTest-1807794048 None] Created reservations ['776b9d1e-dfd8-41bb-992b-f48eea0c9076', '79afc31e-a489-4d35-b185-bd7e38e1d4d9', 'f60b6213-e15c-45fa-8488-e099bd92605a', '91ee5c3e-29b5-4e42-9264-facfd9a86d7b'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 20:57:18.343154 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8a549aca-6f40-428b-83de-9fcd5262b7c3 tempest-TaggedBootDevicesTest-1807794048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:18.462420 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8a549aca-6f40-428b-83de-9fcd5262b7c3 tempest-TaggedBootDevicesTest-1807794048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:18.563060 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-8a549aca-6f40-428b-83de-9fcd5262b7c3 tempest-TaggedBootDevicesTest-1807794048 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:57:18.576249 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-8a549aca-6f40-428b-83de-9fcd5262b7c3 tempest-TaggedBootDevicesTest-1807794048 None] Deleted volume successfully.
Oct 29 20:57:18.604427 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-8a549aca-6f40-428b-83de-9fcd5262b7c3 tempest-TaggedBootDevicesTest-1807794048 None] Lock "cinder-56ccb44a-a3fa-40da-ab2a-b3e0884aaba6-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 20:57:18.718776 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9b9b528a-8b9d-4d32-8341-06bc3f3b74fb tempest-TaggedBootDevicesTest-1807794048 None] Acquiring lock "cinder-2f4a8a96-dc7e-47f8-b92d-9dd0700c950a-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 20:57:18.744334 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9b9b528a-8b9d-4d32-8341-06bc3f3b74fb tempest-TaggedBootDevicesTest-1807794048 None] Lock "cinder-2f4a8a96-dc7e-47f8-b92d-9dd0700c950a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 20:57:18.903725 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9b9b528a-8b9d-4d32-8341-06bc3f3b74fb tempest-TaggedBootDevicesTest-1807794048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:19.086122 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9b9b528a-8b9d-4d32-8341-06bc3f3b74fb tempest-TaggedBootDevicesTest-1807794048 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 20:57:19.089279 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9b9b528a-8b9d-4d32-8341-06bc3f3b74fb tempest-TaggedBootDevicesTest-1807794048 None] Volume volume-2f4a8a96-dc7e-47f8-b92d-9dd0700c950a is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 20:57:19.100125 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9b9b528a-8b9d-4d32-8341-06bc3f3b74fb tempest-TaggedBootDevicesTest-1807794048 None] deleting rbd volume volume-2f4a8a96-dc7e-47f8-b92d-9dd0700c950a {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 20:57:19.749417 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=24,cinder:SELECT=70,cinder:INSERT=5,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:57:19.773505 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-9b9b528a-8b9d-4d32-8341-06bc3f3b74fb tempest-TaggedBootDevicesTest-1807794048 None] Created reservations ['53c93b24-3f64-468a-991c-6fa4ec134bbd', '7b104780-2bc8-462a-a80d-0488755c046f', '9ff81d83-7ebd-4404-aa53-3a920c9f4e7e', 'cc62f105-082f-4886-af9f-eaebbcc08fc2'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 20:57:19.929277 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9b9b528a-8b9d-4d32-8341-06bc3f3b74fb tempest-TaggedBootDevicesTest-1807794048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:20.066442 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9b9b528a-8b9d-4d32-8341-06bc3f3b74fb tempest-TaggedBootDevicesTest-1807794048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:20.201594 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-9b9b528a-8b9d-4d32-8341-06bc3f3b74fb tempest-TaggedBootDevicesTest-1807794048 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:57:20.207015 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-120ce518-9c38-4964-bcb1-c21b1c054fb0 tempest-TaggedBootDevicesTest-1807794048 None] Acquiring lock "cinder-336b3749-7436-45c4-b9f6-b8dd40a60951-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 20:57:20.219330 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-9b9b528a-8b9d-4d32-8341-06bc3f3b74fb tempest-TaggedBootDevicesTest-1807794048 None] Deleted volume successfully.
Oct 29 20:57:20.248754 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-120ce518-9c38-4964-bcb1-c21b1c054fb0 tempest-TaggedBootDevicesTest-1807794048 None] Lock "cinder-336b3749-7436-45c4-b9f6-b8dd40a60951-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 20:57:20.308960 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-463c1b4d-9454-40cc-8755-3d9fb12e674b req-8f6a7741-159e-4fca-bb6d-0b2346519e74 tempest-LiveAutoBlockMigrationV225Test-798039788 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 20:57:20.370032 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9b9b528a-8b9d-4d32-8341-06bc3f3b74fb tempest-TaggedBootDevicesTest-1807794048 None] Lock "cinder-2f4a8a96-dc7e-47f8-b92d-9dd0700c950a-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 20:57:20.464282 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-120ce518-9c38-4964-bcb1-c21b1c054fb0 tempest-TaggedBootDevicesTest-1807794048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:20.635013 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-120ce518-9c38-4964-bcb1-c21b1c054fb0 tempest-TaggedBootDevicesTest-1807794048 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 20:57:20.655331 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-120ce518-9c38-4964-bcb1-c21b1c054fb0 tempest-TaggedBootDevicesTest-1807794048 None] deleting rbd volume volume-336b3749-7436-45c4-b9f6-b8dd40a60951 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 20:57:21.382390 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-120ce518-9c38-4964-bcb1-c21b1c054fb0 tempest-TaggedBootDevicesTest-1807794048 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 20:57:21.438689 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-120ce518-9c38-4964-bcb1-c21b1c054fb0 tempest-TaggedBootDevicesTest-1807794048 None] deleting parent snapshot volume-336b3749-7436-45c4-b9f6-b8dd40a60951.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 20:57:22.393696 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-463c1b4d-9454-40cc-8755-3d9fb12e674b req-8f6a7741-159e-4fca-bb6d-0b2346519e74 tempest-LiveAutoBlockMigrationV225Test-798039788 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.083s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 20:57:22.406197 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-463c1b4d-9454-40cc-8755-3d9fb12e674b req-8f6a7741-159e-4fca-bb6d-0b2346519e74 tempest-LiveAutoBlockMigrationV225Test-798039788 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fd3221f7-f74c-42c3-adb5-0153e2927c11', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'fd3221f7-f74c-42c3-adb5-0153e2927c11', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 20:57:22.532407 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-120ce518-9c38-4964-bcb1-c21b1c054fb0 tempest-TaggedBootDevicesTest-1807794048 None] Created reservations ['c2ba5a09-0644-46c4-a1b0-44fbc6617b3e', '0f937394-e453-4c65-9e78-41db5d0ca2fd', 'c1e04711-7cd4-41e5-85d4-d43454327b5a', '41eaac07-3d9b-423e-87b2-c6fe8447ba2f'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 20:57:22.625936 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-463c1b4d-9454-40cc-8755-3d9fb12e674b req-8f6a7741-159e-4fca-bb6d-0b2346519e74 tempest-LiveAutoBlockMigrationV225Test-798039788 None] Connection info returned from driver {'name': 'volumes/volume-fd3221f7-f74c-42c3-adb5-0153e2927c11', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fd3221f7-f74c-42c3-adb5-0153e2927c11', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '383ee723-9f21-4b1d-aeed-30df396efaf1'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 20:57:22.695874 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-120ce518-9c38-4964-bcb1-c21b1c054fb0 tempest-TaggedBootDevicesTest-1807794048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:22.796728 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=57,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:57:22.805774 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-120ce518-9c38-4964-bcb1-c21b1c054fb0 tempest-TaggedBootDevicesTest-1807794048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:22.926395 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-120ce518-9c38-4964-bcb1-c21b1c054fb0 tempest-TaggedBootDevicesTest-1807794048 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:57:22.983532 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-120ce518-9c38-4964-bcb1-c21b1c054fb0 tempest-TaggedBootDevicesTest-1807794048 None] Deleted volume successfully.
Oct 29 20:57:23.024718 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-463c1b4d-9454-40cc-8755-3d9fb12e674b req-8f6a7741-159e-4fca-bb6d-0b2346519e74 tempest-LiveAutoBlockMigrationV225Test-798039788 None] attachment_update completed successfully.
Oct 29 20:57:23.051442 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-120ce518-9c38-4964-bcb1-c21b1c054fb0 tempest-TaggedBootDevicesTest-1807794048 None] Lock "cinder-336b3749-7436-45c4-b9f6-b8dd40a60951-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 20:57:36.069823 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-463c1b4d-9454-40cc-8755-3d9fb12e674b req-07e62212-cad6-4101-a32c-88fd2f43585b tempest-LiveAutoBlockMigrationV225Test-798039788 None] Terminate volume connection completed successfully.
Oct 29 20:57:36.071070 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-463c1b4d-9454-40cc-8755-3d9fb12e674b req-07e62212-cad6-4101-a32c-88fd2f43585b tempest-LiveAutoBlockMigrationV225Test-798039788 None] Deleting attachment 0261be78-73e0-4251-96fb-55ff663b7c22. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 20:57:52.374441 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=15,cinder:SELECT=38,cinder:DELETE=2,cinder:INSERT=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:57:58.026884 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:57:58.040114 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 req-7d788136-1892-4f7e-a568-dd48ead2c868 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Terminate volume connection completed successfully.
Oct 29 20:57:58.041106 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 req-7d788136-1892-4f7e-a568-dd48ead2c868 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Deleting attachment 383ee723-9f21-4b1d-aeed-30df396efaf1. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 20:57:58.251633 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 req-f0eb6496-ce42-46ba-b4c0-30a09bed0a6d tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Acquiring lock "cinder-fd3221f7-f74c-42c3-adb5-0153e2927c11-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 20:57:58.270280 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 req-f0eb6496-ce42-46ba-b4c0-30a09bed0a6d tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Lock "cinder-fd3221f7-f74c-42c3-adb5-0153e2927c11-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 20:57:58.361208 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 req-f0eb6496-ce42-46ba-b4c0-30a09bed0a6d tempest-LiveAutoBlockMigrationV225Test-1817678524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:58.489786 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 req-f0eb6496-ce42-46ba-b4c0-30a09bed0a6d tempest-LiveAutoBlockMigrationV225Test-1817678524 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 20:57:58.505771 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 req-f0eb6496-ce42-46ba-b4c0-30a09bed0a6d tempest-LiveAutoBlockMigrationV225Test-1817678524 None] deleting rbd volume volume-fd3221f7-f74c-42c3-adb5-0153e2927c11 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 20:57:58.993639 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 req-f0eb6496-ce42-46ba-b4c0-30a09bed0a6d tempest-LiveAutoBlockMigrationV225Test-1817678524 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 20:57:59.034388 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 req-f0eb6496-ce42-46ba-b4c0-30a09bed0a6d tempest-LiveAutoBlockMigrationV225Test-1817678524 None] deleting parent snapshot volume-fd3221f7-f74c-42c3-adb5-0153e2927c11.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 20:57:59.726768 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 req-f0eb6496-ce42-46ba-b4c0-30a09bed0a6d tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Created reservations ['cf2f1362-e883-4026-bb2b-a2b54c1b194c', 'ce556076-138b-4005-a7d5-14cd6822506a', '4ff6c9ee-e712-4906-af20-2322a880f154', 'f615a6ba-16eb-47bf-afcb-8a1fb11116c5'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 20:57:59.825894 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 req-f0eb6496-ce42-46ba-b4c0-30a09bed0a6d tempest-LiveAutoBlockMigrationV225Test-1817678524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:59.905945 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 req-f0eb6496-ce42-46ba-b4c0-30a09bed0a6d tempest-LiveAutoBlockMigrationV225Test-1817678524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:57:59.986746 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 req-f0eb6496-ce42-46ba-b4c0-30a09bed0a6d tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:57:59.993289 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 req-f0eb6496-ce42-46ba-b4c0-30a09bed0a6d tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Deleted volume successfully.
Oct 29 20:58:00.020078 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-4ec54a00-9e4d-4f3e-a86a-ad48582786f4 req-f0eb6496-ce42-46ba-b4c0-30a09bed0a6d tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Lock "cinder-fd3221f7-f74c-42c3-adb5-0153e2927c11-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 20:58:01.374173 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:58:01.375636 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:58:01.465707 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:58:01.537203 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:58:02.371927 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-0d3e50bd-2236-4e3e-b831-d4d54f71c119 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Acquiring lock "cinder-9f151151-e569-44ac-bce7-7e64e381bfb2-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 20:58:02.432616 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-0d3e50bd-2236-4e3e-b831-d4d54f71c119 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Lock "cinder-9f151151-e569-44ac-bce7-7e64e381bfb2-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 20:58:02.538636 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0d3e50bd-2236-4e3e-b831-d4d54f71c119 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:58:02.622522 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0d3e50bd-2236-4e3e-b831-d4d54f71c119 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 20:58:02.623218 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0d3e50bd-2236-4e3e-b831-d4d54f71c119 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Volume volume-9f151151-e569-44ac-bce7-7e64e381bfb2 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 20:58:02.632131 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0d3e50bd-2236-4e3e-b831-d4d54f71c119 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] deleting rbd volume volume-9f151151-e569-44ac-bce7-7e64e381bfb2 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 20:58:03.117555 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-0d3e50bd-2236-4e3e-b831-d4d54f71c119 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Created reservations ['9a6f3870-ebe1-442c-9ec7-8ca88319857e', '7f67814c-026c-4e8d-ad9d-3aa17b93daa9', '0e00fd23-f117-4a7e-ad0a-97e62a314fde', 'e1b46d71-dceb-4da2-b80a-c725a06e2fdf'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 20:58:03.261992 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0d3e50bd-2236-4e3e-b831-d4d54f71c119 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:58:03.358515 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0d3e50bd-2236-4e3e-b831-d4d54f71c119 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:58:03.436373 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-0d3e50bd-2236-4e3e-b831-d4d54f71c119 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:58:03.458662 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-0d3e50bd-2236-4e3e-b831-d4d54f71c119 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Deleted volume successfully.
Oct 29 20:58:03.487171 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-0d3e50bd-2236-4e3e-b831-d4d54f71c119 tempest-LiveAutoBlockMigrationV225Test-1817678524 None] Lock "cinder-9f151151-e569-44ac-bce7-7e64e381bfb2-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 20:58:22.410669 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=23,cinder:INSERT=3,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:58:32.392059 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=38,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:58:52.410842 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:58:52.411951 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:59:01.372613 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 20:59:01.375362 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:59:01.450687 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 20:59:01.543348 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 20:59:32.394500 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:59:32.395255 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 20:59:52.414545 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:00:01.370568 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:00:01.371916 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:00:01.449733 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:00:01.531643 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:00:12.414395 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:00:12.419236 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:00:18.579908 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:00:18.600743 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Flow 'volume_create_manager' (c707d8d5-ac2e-462b-887f-0900247c7621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:00:18.608616 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8263cb1f-20d7-44b3-9371-60b9f0625fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:00:18.625931 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8263cb1f-20d7-44b3-9371-60b9f0625fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-237143083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0bbd16be-48af-49ad-ab22-6f9d08ee7373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47be3cb65cc34590a94a9a161b94a598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:00:19Z,use_quota=True,user_id='d3525b70b7874e7c99485cd7a1efa78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:00:18.631214 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2888e83-376c-4405-8f9e-f91624caea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:00:18.635437 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2888e83-376c-4405-8f9e-f91624caea4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:00:18.640626 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771b1362-4dc0-45f5-b9ff-53c906697066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:00:18.644778 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771b1362-4dc0-45f5-b9ff-53c906697066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bbd16be-48af-49ad-ab22-6f9d08ee7373', 'volume_name': 'volume-0bbd16be-48af-49ad-ab22-6f9d08ee7373', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:00:18.649688 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8351e9-b350-4dc8-97b6-e6d4f1a902f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:00:18.654339 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8351e9-b350-4dc8-97b6-e6d4f1a902f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:00:18.659597 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (469cd156-1d3f-41bb-8af4-050b83185815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:00:18.660905 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Volume 0bbd16be-48af-49ad-ab22-6f9d08ee7373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bbd16be-48af-49ad-ab22-6f9d08ee7373', 'volume_size': 1}
Oct 29 21:00:18.663945 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] creating volume 'volume-0bbd16be-48af-49ad-ab22-6f9d08ee7373' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:00:18.665993 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:00:18.774000 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:00:18.774757 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:00:18.778534 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (469cd156-1d3f-41bb-8af4-050b83185815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bbd16be-48af-49ad-ab22-6f9d08ee7373', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:00:18.797045 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f58a2e-2264-4de2-b373-00402d84aee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:00:18.814513 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Volume volume-0bbd16be-48af-49ad-ab22-6f9d08ee7373 (0bbd16be-48af-49ad-ab22-6f9d08ee7373): created successfully
Oct 29 21:00:18.818262 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f58a2e-2264-4de2-b373-00402d84aee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:00:18.824363 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Flow 'volume_create_manager' (c707d8d5-ac2e-462b-887f-0900247c7621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:00:18.840284 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4a2e13e9-38e4-4a48-843b-4e3304a214ad tempest-ServerRescueNegativeTestJSON-961218988 None] Created volume successfully.
Oct 29 21:00:33.590451 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-7463e5de-4d26-4eaa-bd35-659013d52969 req-eb3874a3-2963-40c2-bcba-6feeb4e77f26 tempest-TaggedBootDevicesTest_v242-1596127670 None] Terminate volume connection completed successfully.
Oct 29 21:00:33.591211 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-7463e5de-4d26-4eaa-bd35-659013d52969 req-eb3874a3-2963-40c2-bcba-6feeb4e77f26 tempest-TaggedBootDevicesTest_v242-1596127670 None] Deleting attachment af8baa56-2eca-4552-866b-d0687ed8f411. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:00:33.713482 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-7463e5de-4d26-4eaa-bd35-659013d52969 req-74b9e609-a248-47d3-83c0-66bf6687167a tempest-TaggedBootDevicesTest_v242-1596127670 None] Terminate volume connection completed successfully.
Oct 29 21:00:33.714066 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-7463e5de-4d26-4eaa-bd35-659013d52969 req-74b9e609-a248-47d3-83c0-66bf6687167a tempest-TaggedBootDevicesTest_v242-1596127670 None] Deleting attachment 4d743185-b9bc-407c-936a-046333658f39. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:00:33.846282 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-7463e5de-4d26-4eaa-bd35-659013d52969 req-e3fcd735-c26e-46be-8b7b-3bda184321f2 tempest-TaggedBootDevicesTest_v242-1596127670 None] Terminate volume connection completed successfully.
Oct 29 21:00:33.846710 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-7463e5de-4d26-4eaa-bd35-659013d52969 req-e3fcd735-c26e-46be-8b7b-3bda184321f2 tempest-TaggedBootDevicesTest_v242-1596127670 None] Deleting attachment 7a43d297-e5ff-4113-81e2-73a55b8f87d9. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:00:42.546947 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-4421e69a-f01d-433b-a11d-f7610344726d tempest-TaggedBootDevicesTest_v242-1596127670 None] Acquiring lock "cinder-3debad03-736d-4863-b27d-c2bed6ae1053-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:00:42.564027 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-4421e69a-f01d-433b-a11d-f7610344726d tempest-TaggedBootDevicesTest_v242-1596127670 None] Lock "cinder-3debad03-736d-4863-b27d-c2bed6ae1053-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:00:42.566507 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=19,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:00:42.581532 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=4,cinder:SELECT=14,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:00:42.646833 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4421e69a-f01d-433b-a11d-f7610344726d tempest-TaggedBootDevicesTest_v242-1596127670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:00:42.728358 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4421e69a-f01d-433b-a11d-f7610344726d tempest-TaggedBootDevicesTest_v242-1596127670 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:00:42.728910 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4421e69a-f01d-433b-a11d-f7610344726d tempest-TaggedBootDevicesTest_v242-1596127670 None] Volume volume-3debad03-736d-4863-b27d-c2bed6ae1053 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:00:42.734694 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4421e69a-f01d-433b-a11d-f7610344726d tempest-TaggedBootDevicesTest_v242-1596127670 None] deleting rbd volume volume-3debad03-736d-4863-b27d-c2bed6ae1053 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:00:43.084561 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-4421e69a-f01d-433b-a11d-f7610344726d tempest-TaggedBootDevicesTest_v242-1596127670 None] Created reservations ['a50fb17e-40bc-4771-8bc7-b73855a4acf5', '4c43c63a-0bee-45d8-83bf-8b04a86f47d3', '9d9d6df9-1e72-4c3d-8af4-239c9244018a', '3da442ae-5a63-47db-b3e2-54412915567e'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:00:43.176085 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4421e69a-f01d-433b-a11d-f7610344726d tempest-TaggedBootDevicesTest_v242-1596127670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:00:43.265483 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4421e69a-f01d-433b-a11d-f7610344726d tempest-TaggedBootDevicesTest_v242-1596127670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:00:43.340311 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-4421e69a-f01d-433b-a11d-f7610344726d tempest-TaggedBootDevicesTest_v242-1596127670 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:00:43.345330 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4421e69a-f01d-433b-a11d-f7610344726d tempest-TaggedBootDevicesTest_v242-1596127670 None] Deleted volume successfully.
Oct 29 21:00:43.361912 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-4421e69a-f01d-433b-a11d-f7610344726d tempest-TaggedBootDevicesTest_v242-1596127670 None] Lock "cinder-3debad03-736d-4863-b27d-c2bed6ae1053-delete_volume" released by "delete_volume" :: held 0.798s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:00:43.740088 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-7ecef14a-c86d-4d5b-8e6a-302f792818c8 tempest-TaggedBootDevicesTest_v242-1596127670 None] Acquiring lock "cinder-ec673dab-2cf6-4dc2-b93f-219ee36ef531-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:00:43.752049 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-7ecef14a-c86d-4d5b-8e6a-302f792818c8 tempest-TaggedBootDevicesTest_v242-1596127670 None] Lock "cinder-ec673dab-2cf6-4dc2-b93f-219ee36ef531-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:00:43.840588 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7ecef14a-c86d-4d5b-8e6a-302f792818c8 tempest-TaggedBootDevicesTest_v242-1596127670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:00:43.944576 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7ecef14a-c86d-4d5b-8e6a-302f792818c8 tempest-TaggedBootDevicesTest_v242-1596127670 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:00:43.945267 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7ecef14a-c86d-4d5b-8e6a-302f792818c8 tempest-TaggedBootDevicesTest_v242-1596127670 None] Volume volume-ec673dab-2cf6-4dc2-b93f-219ee36ef531 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:00:43.957113 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7ecef14a-c86d-4d5b-8e6a-302f792818c8 tempest-TaggedBootDevicesTest_v242-1596127670 None] deleting rbd volume volume-ec673dab-2cf6-4dc2-b93f-219ee36ef531 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:00:44.316590 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-7ecef14a-c86d-4d5b-8e6a-302f792818c8 tempest-TaggedBootDevicesTest_v242-1596127670 None] Created reservations ['42f8fac0-8eae-42a7-a1de-292cc2b1955a', '03059345-7de8-450b-a4cc-fcf755ed20a6', '4968132a-f3c6-4961-924e-981a1f84230d', 'b39432dc-0d77-4718-8575-1fb3cd68404b'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:00:44.392595 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7ecef14a-c86d-4d5b-8e6a-302f792818c8 tempest-TaggedBootDevicesTest_v242-1596127670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:00:44.464056 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7ecef14a-c86d-4d5b-8e6a-302f792818c8 tempest-TaggedBootDevicesTest_v242-1596127670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:00:44.544098 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-7ecef14a-c86d-4d5b-8e6a-302f792818c8 tempest-TaggedBootDevicesTest_v242-1596127670 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:00:44.549101 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7ecef14a-c86d-4d5b-8e6a-302f792818c8 tempest-TaggedBootDevicesTest_v242-1596127670 None] Deleted volume successfully.
Oct 29 21:00:44.565045 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-7ecef14a-c86d-4d5b-8e6a-302f792818c8 tempest-TaggedBootDevicesTest_v242-1596127670 None] Lock "cinder-ec673dab-2cf6-4dc2-b93f-219ee36ef531-delete_volume" released by "delete_volume" :: held 0.813s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:00:45.048603 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c26fd11d-73c7-4dd2-93ae-af96d35258a9 tempest-TaggedBootDevicesTest_v242-1596127670 None] Acquiring lock "cinder-f63b060b-36c0-43ae-9fa9-42a926d80cd7-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:00:45.070566 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c26fd11d-73c7-4dd2-93ae-af96d35258a9 tempest-TaggedBootDevicesTest_v242-1596127670 None] Lock "cinder-f63b060b-36c0-43ae-9fa9-42a926d80cd7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:00:45.128265 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c26fd11d-73c7-4dd2-93ae-af96d35258a9 tempest-TaggedBootDevicesTest_v242-1596127670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:00:45.239690 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c26fd11d-73c7-4dd2-93ae-af96d35258a9 tempest-TaggedBootDevicesTest_v242-1596127670 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:00:45.251717 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c26fd11d-73c7-4dd2-93ae-af96d35258a9 tempest-TaggedBootDevicesTest_v242-1596127670 None] deleting rbd volume volume-f63b060b-36c0-43ae-9fa9-42a926d80cd7 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:00:45.646380 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c26fd11d-73c7-4dd2-93ae-af96d35258a9 tempest-TaggedBootDevicesTest_v242-1596127670 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 21:00:45.710372 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c26fd11d-73c7-4dd2-93ae-af96d35258a9 tempest-TaggedBootDevicesTest_v242-1596127670 None] deleting parent snapshot volume-f63b060b-36c0-43ae-9fa9-42a926d80cd7.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 21:00:46.690613 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-c26fd11d-73c7-4dd2-93ae-af96d35258a9 tempest-TaggedBootDevicesTest_v242-1596127670 None] Created reservations ['62c8aeb1-7ab0-4b20-956b-f2a288bb8117', '6078c1b4-9c6d-4278-80b8-e925c159cfe2', '315f1cb0-9dcd-46ee-94b0-6eab53c43a6e', 'efef8215-79da-419f-84ff-c8fd8a9bda39'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:00:46.768056 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c26fd11d-73c7-4dd2-93ae-af96d35258a9 tempest-TaggedBootDevicesTest_v242-1596127670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:00:46.854462 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c26fd11d-73c7-4dd2-93ae-af96d35258a9 tempest-TaggedBootDevicesTest_v242-1596127670 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:00:46.927929 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-c26fd11d-73c7-4dd2-93ae-af96d35258a9 tempest-TaggedBootDevicesTest_v242-1596127670 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:00:46.932110 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-c26fd11d-73c7-4dd2-93ae-af96d35258a9 tempest-TaggedBootDevicesTest_v242-1596127670 None] Deleted volume successfully.
Oct 29 21:00:46.948926 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c26fd11d-73c7-4dd2-93ae-af96d35258a9 tempest-TaggedBootDevicesTest_v242-1596127670 None] Lock "cinder-f63b060b-36c0-43ae-9fa9-42a926d80cd7-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:00:52.281156 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:00:52.336221 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Flow 'volume_create_manager' (608d0489-d106-4ff1-837e-524763c5d644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:00:52.347274 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c909f887-de9c-45f6-845d-8f068c3f8042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:00:52.366425 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c909f887-de9c-45f6-845d-8f068c3f8042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1936515946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=360b708f-faff-4312-b818-452b6e0d9153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47be3cb65cc34590a94a9a161b94a598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:00:52Z,use_quota=True,user_id='d3525b70b7874e7c99485cd7a1efa78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:00:52.398595 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f25fbe-2658-4e6e-af6b-559cd5503a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:00:52.409548 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f25fbe-2658-4e6e-af6b-559cd5503a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:00:52.422771 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f025ec85-b26e-4812-b57d-2f3046102e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:00:52.431741 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f025ec85-b26e-4812-b57d-2f3046102e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360b708f-faff-4312-b818-452b6e0d9153', 'volume_name': 'volume-360b708f-faff-4312-b818-452b6e0d9153', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:00:52.445197 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e78b7b-410c-4a63-ac1f-43d4af0a32b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:00:52.451222 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e78b7b-410c-4a63-ac1f-43d4af0a32b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:00:52.456285 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308144a0-0f8e-4b3d-8e3b-3c81f8ffea5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:00:52.458414 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Volume 360b708f-faff-4312-b818-452b6e0d9153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360b708f-faff-4312-b818-452b6e0d9153', 'volume_size': 1}
Oct 29 21:00:52.458980 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] creating volume 'volume-360b708f-faff-4312-b818-452b6e0d9153' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:00:52.460011 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:00:52.569433 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:00:52.569790 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:00:52.573394 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308144a0-0f8e-4b3d-8e3b-3c81f8ffea5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360b708f-faff-4312-b818-452b6e0d9153', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:00:52.582336 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13274474-555b-4320-9fdd-e641b84a6a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:00:52.607065 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Volume volume-360b708f-faff-4312-b818-452b6e0d9153 (360b708f-faff-4312-b818-452b6e0d9153): created successfully
Oct 29 21:00:52.614579 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13274474-555b-4320-9fdd-e641b84a6a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:00:52.625738 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Flow 'volume_create_manager' (608d0489-d106-4ff1-837e-524763c5d644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:00:52.642608 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7fd582d2-5aa9-4e10-a09b-881ffe6007cf tempest-ServerRescueNegativeTestJSON-961218988 None] Created volume successfully.
Oct 29 21:01:01.366796 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:01:01.367746 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:01:01.431584 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:01:01.539414 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:01:12.511754 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=35,cinder:INSERT=7,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:01:22.506508 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=52,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:01:42.519473 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:01:42.522035 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:02:01.370271 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:02:01.371069 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:02:01.443555 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:02:01.508223 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:02:02.520954 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:02:05.238640 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-28aaa598-a008-4e9e-8c02-16757fa78e62 req-e5a71310-d484-4b87-aac1-7799133e4ffb tempest-ServerRescueNegativeTestJSON-961218988 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:02:06.739388 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-28aaa598-a008-4e9e-8c02-16757fa78e62 req-e5a71310-d484-4b87-aac1-7799133e4ffb tempest-ServerRescueNegativeTestJSON-961218988 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.500s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:02:06.746040 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-28aaa598-a008-4e9e-8c02-16757fa78e62 req-e5a71310-d484-4b87-aac1-7799133e4ffb tempest-ServerRescueNegativeTestJSON-961218988 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-360b708f-faff-4312-b818-452b6e0d9153', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '360b708f-faff-4312-b818-452b6e0d9153', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:02:06.786687 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-28aaa598-a008-4e9e-8c02-16757fa78e62 req-e5a71310-d484-4b87-aac1-7799133e4ffb tempest-ServerRescueNegativeTestJSON-961218988 None] Connection info returned from driver {'name': 'volumes/volume-360b708f-faff-4312-b818-452b6e0d9153', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '360b708f-faff-4312-b818-452b6e0d9153', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '872c9131-e81f-4edd-9816-31a20ba70165'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:02:06.909440 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-28aaa598-a008-4e9e-8c02-16757fa78e62 req-e5a71310-d484-4b87-aac1-7799133e4ffb tempest-ServerRescueNegativeTestJSON-961218988 None] attachment_update completed successfully.
Oct 29 21:02:22.525398 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=19,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:02:32.541730 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:03:01.373241 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:03:01.374841 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:03:01.423726 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:03:01.475423 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:03:02.536561 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:03:16.239490 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:03:16.256287 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-7c2e33df-40e6-41d2-8e81-8e3522551f75 req-d44b25a1-aa4c-45ea-bec9-93c17d59824d tempest-ServerRescueNegativeTestJSON-961218988 None] Terminate volume connection completed successfully.
Oct 29 21:03:16.259057 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-7c2e33df-40e6-41d2-8e81-8e3522551f75 req-d44b25a1-aa4c-45ea-bec9-93c17d59824d tempest-ServerRescueNegativeTestJSON-961218988 None] Deleting attachment 872c9131-e81f-4edd-9816-31a20ba70165. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:03:32.554579 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:03:32.566230 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:03:34.643069 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-6d18eab4-bbf4-488b-8bb3-deffcb7e3d1a tempest-ServerRescueNegativeTestJSON-961218988 None] Acquiring lock "cinder-360b708f-faff-4312-b818-452b6e0d9153-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:03:34.685626 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-6d18eab4-bbf4-488b-8bb3-deffcb7e3d1a tempest-ServerRescueNegativeTestJSON-961218988 None] Lock "cinder-360b708f-faff-4312-b818-452b6e0d9153-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:03:34.787780 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6d18eab4-bbf4-488b-8bb3-deffcb7e3d1a tempest-ServerRescueNegativeTestJSON-961218988 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:03:34.858528 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6d18eab4-bbf4-488b-8bb3-deffcb7e3d1a tempest-ServerRescueNegativeTestJSON-961218988 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:03:34.859001 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6d18eab4-bbf4-488b-8bb3-deffcb7e3d1a tempest-ServerRescueNegativeTestJSON-961218988 None] Volume volume-360b708f-faff-4312-b818-452b6e0d9153 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:03:34.864927 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6d18eab4-bbf4-488b-8bb3-deffcb7e3d1a tempest-ServerRescueNegativeTestJSON-961218988 None] deleting rbd volume volume-360b708f-faff-4312-b818-452b6e0d9153 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:03:35.311306 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-6d18eab4-bbf4-488b-8bb3-deffcb7e3d1a tempest-ServerRescueNegativeTestJSON-961218988 None] Created reservations ['0bef1b2b-9ba6-42d3-a4e9-79eff8fe98c1', '500aee9f-5c03-4deb-8731-8afaafc37e8f', 'cf44487a-a2e9-4f59-92a3-f3e0975d2f1f', '1b9e3370-c35c-4cc9-b93d-3f57ad0a103f'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:03:35.520670 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6d18eab4-bbf4-488b-8bb3-deffcb7e3d1a tempest-ServerRescueNegativeTestJSON-961218988 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:03:35.607500 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6d18eab4-bbf4-488b-8bb3-deffcb7e3d1a tempest-ServerRescueNegativeTestJSON-961218988 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:03:35.703252 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-6d18eab4-bbf4-488b-8bb3-deffcb7e3d1a tempest-ServerRescueNegativeTestJSON-961218988 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:03:35.709045 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-6d18eab4-bbf4-488b-8bb3-deffcb7e3d1a tempest-ServerRescueNegativeTestJSON-961218988 None] Deleted volume successfully.
Oct 29 21:03:35.735608 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-6d18eab4-bbf4-488b-8bb3-deffcb7e3d1a tempest-ServerRescueNegativeTestJSON-961218988 None] Lock "cinder-360b708f-faff-4312-b818-452b6e0d9153-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:03:35.957342 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e792c3c8-3228-4d3c-b13a-b7db45e23f5f tempest-ServerRescueNegativeTestJSON-961218988 None] Acquiring lock "cinder-0bbd16be-48af-49ad-ab22-6f9d08ee7373-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:03:35.974192 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e792c3c8-3228-4d3c-b13a-b7db45e23f5f tempest-ServerRescueNegativeTestJSON-961218988 None] Lock "cinder-0bbd16be-48af-49ad-ab22-6f9d08ee7373-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:03:36.034908 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e792c3c8-3228-4d3c-b13a-b7db45e23f5f tempest-ServerRescueNegativeTestJSON-961218988 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:03:36.123098 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e792c3c8-3228-4d3c-b13a-b7db45e23f5f tempest-ServerRescueNegativeTestJSON-961218988 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:03:36.123540 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e792c3c8-3228-4d3c-b13a-b7db45e23f5f tempest-ServerRescueNegativeTestJSON-961218988 None] Volume volume-0bbd16be-48af-49ad-ab22-6f9d08ee7373 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:03:36.137635 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e792c3c8-3228-4d3c-b13a-b7db45e23f5f tempest-ServerRescueNegativeTestJSON-961218988 None] deleting rbd volume volume-0bbd16be-48af-49ad-ab22-6f9d08ee7373 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:03:36.516250 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-e792c3c8-3228-4d3c-b13a-b7db45e23f5f tempest-ServerRescueNegativeTestJSON-961218988 None] Created reservations ['981d25db-5666-4acf-be39-540a25dd7cd3', '1861feb6-e6d8-4348-8d0b-5771c901f921', 'ba801e2f-f662-4738-964c-6b00c09270e6', 'b1b65370-7d0f-4d5c-8b11-71ee5d6a7e80'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:03:36.730731 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e792c3c8-3228-4d3c-b13a-b7db45e23f5f tempest-ServerRescueNegativeTestJSON-961218988 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:03:36.843053 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e792c3c8-3228-4d3c-b13a-b7db45e23f5f tempest-ServerRescueNegativeTestJSON-961218988 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:03:36.916534 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-e792c3c8-3228-4d3c-b13a-b7db45e23f5f tempest-ServerRescueNegativeTestJSON-961218988 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:03:36.922271 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-e792c3c8-3228-4d3c-b13a-b7db45e23f5f tempest-ServerRescueNegativeTestJSON-961218988 None] Deleted volume successfully.
Oct 29 21:03:36.946450 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e792c3c8-3228-4d3c-b13a-b7db45e23f5f tempest-ServerRescueNegativeTestJSON-961218988 None] Lock "cinder-0bbd16be-48af-49ad-ab22-6f9d08ee7373-delete_volume" released by "delete_volume" :: held 0.972s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:03:46.020848 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:03:46.069264 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Flow 'volume_create_manager' (aab75c48-fa4b-424f-997e-633472a165d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:03:46.084789 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d848e8b-e8ad-4e6c-8157-773a4cc2495b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:03:46.125791 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d848e8b-e8ad-4e6c-8157-773a4cc2495b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-487588253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d0a58bc7-10e3-494c-b645-6c64967586b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a46c1f647934440925ebc5e0b373ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:03:46Z,use_quota=True,user_id='282339dc65a54bc99850b172ed427d75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:03:46.139289 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063edbd9-84a6-427c-9ed2-33682e9db66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:03:46.143393 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (063edbd9-84a6-427c-9ed2-33682e9db66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:03:46.152402 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b20f72-4176-46db-b500-e09a1b3a19f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:03:46.167904 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b20f72-4176-46db-b500-e09a1b3a19f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a58bc7-10e3-494c-b645-6c64967586b9', 'volume_name': 'volume-d0a58bc7-10e3-494c-b645-6c64967586b9', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:03:46.175251 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43529206-f39f-435b-9e6c-007576beee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:03:46.197162 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43529206-f39f-435b-9e6c-007576beee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:03:46.201911 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b2c80d-bc59-4c1f-a5fb-5c6ac9009ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:03:46.203029 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Volume d0a58bc7-10e3-494c-b645-6c64967586b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a58bc7-10e3-494c-b645-6c64967586b9', 'volume_size': 1}
Oct 29 21:03:46.203511 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] creating volume 'volume-d0a58bc7-10e3-494c-b645-6c64967586b9' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:03:46.204302 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:03:46.339121 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:03:46.339927 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:03:46.345555 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b2c80d-bc59-4c1f-a5fb-5c6ac9009ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a58bc7-10e3-494c-b645-6c64967586b9', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:03:46.351557 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07c98ae-bc2c-44a9-8033-bca16685f1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:03:46.377698 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Volume volume-d0a58bc7-10e3-494c-b645-6c64967586b9 (d0a58bc7-10e3-494c-b645-6c64967586b9): created successfully
Oct 29 21:03:46.390826 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07c98ae-bc2c-44a9-8033-bca16685f1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:03:46.409396 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Flow 'volume_create_manager' (aab75c48-fa4b-424f-997e-633472a165d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:03:46.432976 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-2eeadcee-73c1-4770-8fe3-f2530fecef39 tempest-DeleteServersTestJSON-860327279 None] Created volume successfully.
Oct 29 21:03:51.387909 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-ef095c61-9924-4363-bbc3-b8c922afbfb7 req-51564a84-20f6-4e41-8b52-681fd24920c1 tempest-DeleteServersTestJSON-860327279 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:03:52.862849 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-ef095c61-9924-4363-bbc3-b8c922afbfb7 req-51564a84-20f6-4e41-8b52-681fd24920c1 tempest-DeleteServersTestJSON-860327279 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.475s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:03:52.863595 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-ef095c61-9924-4363-bbc3-b8c922afbfb7 req-51564a84-20f6-4e41-8b52-681fd24920c1 tempest-DeleteServersTestJSON-860327279 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d0a58bc7-10e3-494c-b645-6c64967586b9', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'd0a58bc7-10e3-494c-b645-6c64967586b9', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:03:52.899923 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-ef095c61-9924-4363-bbc3-b8c922afbfb7 req-51564a84-20f6-4e41-8b52-681fd24920c1 tempest-DeleteServersTestJSON-860327279 None] Connection info returned from driver {'name': 'volumes/volume-d0a58bc7-10e3-494c-b645-6c64967586b9', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd0a58bc7-10e3-494c-b645-6c64967586b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'df12ce39-6b15-4bdf-9800-7bbfeae3568b'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:03:52.960648 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-ef095c61-9924-4363-bbc3-b8c922afbfb7 req-51564a84-20f6-4e41-8b52-681fd24920c1 tempest-DeleteServersTestJSON-860327279 None] attachment_update completed successfully.
Oct 29 21:04:01.235925 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-4aea84fc-3912-4783-b53e-ce9655f0c513 req-aaf6f73e-5490-4974-b777-88d580d210f3 tempest-DeleteServersTestJSON-860327279 None] Terminate volume connection completed successfully.
Oct 29 21:04:01.236505 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4aea84fc-3912-4783-b53e-ce9655f0c513 req-aaf6f73e-5490-4974-b777-88d580d210f3 tempest-DeleteServersTestJSON-860327279 None] Deleting attachment df12ce39-6b15-4bdf-9800-7bbfeae3568b. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:04:01.372217 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:04:01.373048 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:04:01.438131 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:04:01.507058 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:04:12.544281 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=42,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:04:12.546232 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=19,cinder:SELECT=50,cinder:DELETE=2,cinder:INSERT=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:04:38.321534 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:04:38.347370 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Flow 'volume_create_manager' (fc827e7e-86af-4737-98a8-a1e982a38a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:04:38.357525 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47d1523-042c-4708-a96c-4d19dcbd410f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:04:38.378264 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47d1523-042c-4708-a96c-4d19dcbd410f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1591559093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=faba7380-43fe-45bc-924c-8ae70d5ba3fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2d730ddfcf9a4b5493459c945d5a1f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:04:38Z,use_quota=True,user_id='08ac0426dab4419192fa23ffe3394b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:04:38.389882 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8aafa4-0c35-4a0d-a3f3-e2970512ad6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:04:38.401563 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8aafa4-0c35-4a0d-a3f3-e2970512ad6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:04:38.406930 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c168bdb-258b-4653-98f6-3af79e4576cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:04:38.410898 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c168bdb-258b-4653-98f6-3af79e4576cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faba7380-43fe-45bc-924c-8ae70d5ba3fe', 'volume_name': 'volume-faba7380-43fe-45bc-924c-8ae70d5ba3fe', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:04:38.415665 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba458231-2525-437d-b427-602477afcfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:04:38.420166 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba458231-2525-437d-b427-602477afcfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:04:38.425603 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14cda82-22f8-42a9-98cc-d069b490163b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:04:38.427393 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Volume faba7380-43fe-45bc-924c-8ae70d5ba3fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faba7380-43fe-45bc-924c-8ae70d5ba3fe', 'volume_size': 1}
Oct 29 21:04:38.427965 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] creating volume 'volume-faba7380-43fe-45bc-924c-8ae70d5ba3fe' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:04:38.429202 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:04:38.531736 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:04:38.532357 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:04:38.537934 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14cda82-22f8-42a9-98cc-d069b490163b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faba7380-43fe-45bc-924c-8ae70d5ba3fe', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:04:38.545499 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75b0deb-fc8e-4534-93d1-0d6df84e0aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:04:38.560840 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Volume volume-faba7380-43fe-45bc-924c-8ae70d5ba3fe (faba7380-43fe-45bc-924c-8ae70d5ba3fe): created successfully
Oct 29 21:04:38.564558 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75b0deb-fc8e-4534-93d1-0d6df84e0aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:04:38.571060 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Flow 'volume_create_manager' (fc827e7e-86af-4737-98a8-a1e982a38a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:04:38.580738 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-471436ad-2dd5-4021-9b5f-b30915155445 req-d575787d-0856-4db0-baeb-df0c696703ad tempest-VolumesGetTestJSON-533515448 None] Created volume successfully.
Oct 29 21:04:39.501227 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-6ce48ef6-2599-4f2d-8f77-541417d0bb3f req-e4886d31-8dd8-4b2a-bc70-36be1290552e tempest-VolumesGetTestJSON-533515448 None] Acquiring lock "cinder-faba7380-43fe-45bc-924c-8ae70d5ba3fe-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:04:39.515821 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-6ce48ef6-2599-4f2d-8f77-541417d0bb3f req-e4886d31-8dd8-4b2a-bc70-36be1290552e tempest-VolumesGetTestJSON-533515448 None] Lock "cinder-faba7380-43fe-45bc-924c-8ae70d5ba3fe-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:04:39.599965 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-6ce48ef6-2599-4f2d-8f77-541417d0bb3f req-e4886d31-8dd8-4b2a-bc70-36be1290552e tempest-VolumesGetTestJSON-533515448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:04:39.681758 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-6ce48ef6-2599-4f2d-8f77-541417d0bb3f req-e4886d31-8dd8-4b2a-bc70-36be1290552e tempest-VolumesGetTestJSON-533515448 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:04:39.682389 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-6ce48ef6-2599-4f2d-8f77-541417d0bb3f req-e4886d31-8dd8-4b2a-bc70-36be1290552e tempest-VolumesGetTestJSON-533515448 None] Volume volume-faba7380-43fe-45bc-924c-8ae70d5ba3fe is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:04:39.692896 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-6ce48ef6-2599-4f2d-8f77-541417d0bb3f req-e4886d31-8dd8-4b2a-bc70-36be1290552e tempest-VolumesGetTestJSON-533515448 None] deleting rbd volume volume-faba7380-43fe-45bc-924c-8ae70d5ba3fe {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:04:40.099612 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [req-6ce48ef6-2599-4f2d-8f77-541417d0bb3f req-e4886d31-8dd8-4b2a-bc70-36be1290552e tempest-VolumesGetTestJSON-533515448 None] Created reservations ['636fa882-c856-45ba-85a5-9ede53ffed01', 'fb293867-1bae-4e87-992c-2feccf42b697', 'becb92fb-1021-426d-b454-ed1aaa8b6138', '6c70857c-9aba-4ed1-beaf-5d8b71432da9'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:04:40.159335 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-6ce48ef6-2599-4f2d-8f77-541417d0bb3f req-e4886d31-8dd8-4b2a-bc70-36be1290552e tempest-VolumesGetTestJSON-533515448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:04:40.218124 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-6ce48ef6-2599-4f2d-8f77-541417d0bb3f req-e4886d31-8dd8-4b2a-bc70-36be1290552e tempest-VolumesGetTestJSON-533515448 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:04:40.261896 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [req-6ce48ef6-2599-4f2d-8f77-541417d0bb3f req-e4886d31-8dd8-4b2a-bc70-36be1290552e tempest-VolumesGetTestJSON-533515448 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:04:40.266599 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-6ce48ef6-2599-4f2d-8f77-541417d0bb3f req-e4886d31-8dd8-4b2a-bc70-36be1290552e tempest-VolumesGetTestJSON-533515448 None] Deleted volume successfully.
Oct 29 21:04:40.284259 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-6ce48ef6-2599-4f2d-8f77-541417d0bb3f req-e4886d31-8dd8-4b2a-bc70-36be1290552e tempest-VolumesGetTestJSON-533515448 None] Lock "cinder-faba7380-43fe-45bc-924c-8ae70d5ba3fe-delete_volume" released by "delete_volume" :: held 0.768s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:04:50.272243 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=24,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:04:52.559239 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=19,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:04:57.850770 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:04:57.916615 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Flow 'volume_create_manager' (b2faf9fd-44bf-45ca-8664-4f280f773bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:04:57.935154 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea82bae-ca94-4380-a7f1-83ecd32deefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:04:57.989200 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea82bae-ca94-4380-a7f1-83ecd32deefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-558508950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6795ea29-e00f-4ecb-b9e9-c60c491b9c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6173752e65384e85a2bcc8c3e542931a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:04:58Z,use_quota=True,user_id='7c7c243e53fb4f3a895b665028a14373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:04:58.000610 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c629df-7965-44ab-8833-cdc6ee2c5890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:04:58.005382 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c629df-7965-44ab-8833-cdc6ee2c5890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:04:58.013683 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3afecb-e73e-409a-83ca-dbb13f9dab38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:04:58.025006 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3afecb-e73e-409a-83ca-dbb13f9dab38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6795ea29-e00f-4ecb-b9e9-c60c491b9c9d', 'volume_name': 'volume-6795ea29-e00f-4ecb-b9e9-c60c491b9c9d', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:04:58.036512 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (734a74c0-5023-4335-960f-a772b26792d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:04:58.046716 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (734a74c0-5023-4335-960f-a772b26792d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:04:58.071661 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e0be6a-99af-43c6-81cd-41619fc2d89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:04:58.074388 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Volume 6795ea29-e00f-4ecb-b9e9-c60c491b9c9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6795ea29-e00f-4ecb-b9e9-c60c491b9c9d', 'volume_size': 1}
Oct 29 21:04:58.074893 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] creating volume 'volume-6795ea29-e00f-4ecb-b9e9-c60c491b9c9d' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:04:58.075828 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:04:58.217201 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:04:58.217816 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:04:58.222549 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e0be6a-99af-43c6-81cd-41619fc2d89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6795ea29-e00f-4ecb-b9e9-c60c491b9c9d', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:04:58.247160 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1122164d-8933-4616-b10d-061102f6e263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:04:58.276257 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Volume volume-6795ea29-e00f-4ecb-b9e9-c60c491b9c9d (6795ea29-e00f-4ecb-b9e9-c60c491b9c9d): created successfully
Oct 29 21:04:58.281413 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1122164d-8933-4616-b10d-061102f6e263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:04:58.328757 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Flow 'volume_create_manager' (b2faf9fd-44bf-45ca-8664-4f280f773bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:04:58.358650 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-dc4272a4-355f-44e8-b3b0-f1f124a36f9b tempest-ServersNegativeTestJSON-1286545161 None] Created volume successfully.
Oct 29 21:05:01.370990 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:05:01.374359 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:05:01.460906 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:05:01.548010 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:05:01.624316 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:05:01.679400 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Flow 'volume_create_manager' (df28f4f1-80db-4f6f-97ac-2b17f5fc870c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:05:01.685837 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b482d82f-e59d-4074-8907-aa0bd7f0b0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:05:01.713945 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b482d82f-e59d-4074-8907-aa0bd7f0b0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-476628597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=41e8bc52-fb85-4a77-b392-bddd056f4bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6173752e65384e85a2bcc8c3e542931a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:05:01Z,use_quota=True,user_id='7c7c243e53fb4f3a895b665028a14373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:05:01.726705 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2166d91-d236-4670-93cf-1c0979527a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:05:01.740817 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2166d91-d236-4670-93cf-1c0979527a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:05:01.756331 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb089b0a-6020-4979-90ea-d89d71779e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:05:01.763621 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb089b0a-6020-4979-90ea-d89d71779e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e8bc52-fb85-4a77-b392-bddd056f4bc8', 'volume_name': 'volume-41e8bc52-fb85-4a77-b392-bddd056f4bc8', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:05:01.784850 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf003d83-0388-44a1-aae5-fa7cb345440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:05:01.796171 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf003d83-0388-44a1-aae5-fa7cb345440d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:05:01.802207 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b69aa3f-9a51-48ef-b34c-cea1a013537c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:05:01.803493 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Volume 41e8bc52-fb85-4a77-b392-bddd056f4bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e8bc52-fb85-4a77-b392-bddd056f4bc8', 'volume_size': 1}
Oct 29 21:05:01.804084 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] creating volume 'volume-41e8bc52-fb85-4a77-b392-bddd056f4bc8' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:05:01.804911 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:05:01.958672 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:05:01.959601 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:05:01.964779 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b69aa3f-9a51-48ef-b34c-cea1a013537c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e8bc52-fb85-4a77-b392-bddd056f4bc8', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:05:01.974812 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f2958c-05d8-4b31-85a3-1b22f556c43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:05:01.987521 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Volume volume-41e8bc52-fb85-4a77-b392-bddd056f4bc8 (41e8bc52-fb85-4a77-b392-bddd056f4bc8): created successfully
Oct 29 21:05:01.996863 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f2958c-05d8-4b31-85a3-1b22f556c43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:05:02.002113 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Flow 'volume_create_manager' (df28f4f1-80db-4f6f-97ac-2b17f5fc870c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:05:02.029152 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-33a182d6-0a71-45f1-9a7a-f80512ad6928 tempest-ServersNegativeTestJSON-1286545161 None] Created volume successfully.
Oct 29 21:05:12.559688 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:05:31.183765 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:05:31.198373 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:05:31.223394 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Flow 'volume_create_manager' (181303d3-9403-4b87-9915-c84b09398cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:05:31.234961 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc71488-76c7-4dc0-bff7-0e99ec01d9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:05:31.279034 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc71488-76c7-4dc0-bff7-0e99ec01d9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1244213848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4a921766-a21e-4791-bb5f-563fd4150c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4e54075f50e468dbd398cc3df0d30a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:05:31Z,use_quota=True,user_id='317c7fc1b0be4187bb3b719ac5c8fde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:05:31.285277 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158a4fe4-9c55-4be3-ac4a-22cb33e7af0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:05:31.291260 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158a4fe4-9c55-4be3-ac4a-22cb33e7af0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:05:31.297243 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3e389c-8129-4d8b-a6d5-afb58ab25b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:05:31.302147 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3e389c-8129-4d8b-a6d5-afb58ab25b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a921766-a21e-4791-bb5f-563fd4150c2a', 'volume_name': 'volume-4a921766-a21e-4791-bb5f-563fd4150c2a', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:05:31.309098 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253182b0-8a16-4f1d-a0fb-3cc756076420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:05:31.315279 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (253182b0-8a16-4f1d-a0fb-3cc756076420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:05:31.322566 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6759a45-2264-4285-a97d-5c3f311584c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:05:31.328134 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Volume 4a921766-a21e-4791-bb5f-563fd4150c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a921766-a21e-4791-bb5f-563fd4150c2a', 'volume_size': 1}
Oct 29 21:05:31.328718 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] creating volume 'volume-4a921766-a21e-4791-bb5f-563fd4150c2a' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:05:31.329874 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:05:31.466483 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:05:31.467233 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:05:31.471429 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6759a45-2264-4285-a97d-5c3f311584c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a921766-a21e-4791-bb5f-563fd4150c2a', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:05:31.476990 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bc8180-5a3e-4d3f-acdf-8810eb9a1752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:05:31.493405 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Volume volume-4a921766-a21e-4791-bb5f-563fd4150c2a (4a921766-a21e-4791-bb5f-563fd4150c2a): created successfully
Oct 29 21:05:31.498521 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bc8180-5a3e-4d3f-acdf-8810eb9a1752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:05:31.508756 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Flow 'volume_create_manager' (181303d3-9403-4b87-9915-c84b09398cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:05:31.543854 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-37b966b7-0fc5-4b95-95e7-45145d2455d5 tempest-VolumesAdminNegativeTest-775941430 None] Created volume successfully.
Oct 29 21:05:33.331144 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-91506595-625f-42fd-8092-f98a685fe769 req-5db83574-e38f-41a5-a051-6fe0e6ba54ad tempest-VolumesAdminNegativeTest-775941430 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:05:34.645484 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-91506595-625f-42fd-8092-f98a685fe769 req-5db83574-e38f-41a5-a051-6fe0e6ba54ad tempest-VolumesAdminNegativeTest-775941430 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.314s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:05:34.646380 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-91506595-625f-42fd-8092-f98a685fe769 req-5db83574-e38f-41a5-a051-6fe0e6ba54ad tempest-VolumesAdminNegativeTest-775941430 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4a921766-a21e-4791-bb5f-563fd4150c2a', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '4a921766-a21e-4791-bb5f-563fd4150c2a', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:05:34.734262 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-91506595-625f-42fd-8092-f98a685fe769 req-5db83574-e38f-41a5-a051-6fe0e6ba54ad tempest-VolumesAdminNegativeTest-775941430 None] Connection info returned from driver {'name': 'volumes/volume-4a921766-a21e-4791-bb5f-563fd4150c2a', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4a921766-a21e-4791-bb5f-563fd4150c2a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '98ab2e27-b20e-4c8c-ac76-c4a49c46c130'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:05:34.842999 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-91506595-625f-42fd-8092-f98a685fe769 req-5db83574-e38f-41a5-a051-6fe0e6ba54ad tempest-VolumesAdminNegativeTest-775941430 None] attachment_update completed successfully.
Oct 29 21:05:39.957123 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-36b203e3-bd9a-44e7-9797-bd42dc388253 req-3b7c9beb-1e75-42df-bf80-a4f75782e86b tempest-VolumesAdminNegativeTest-775941430 None] Terminate volume connection completed successfully.
Oct 29 21:05:39.968632 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-36b203e3-bd9a-44e7-9797-bd42dc388253 req-3b7c9beb-1e75-42df-bf80-a4f75782e86b tempest-VolumesAdminNegativeTest-775941430 None] Deleting attachment 98ab2e27-b20e-4c8c-ac76-c4a49c46c130. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:05:52.560331 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=20,cinder:UPDATE=7 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:06:01.369046 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:06:01.371322 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:06:01.471822 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:06:01.545319 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:06:02.568563 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=23,cinder:DELETE=1,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:06:14.683104 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:06:14.722551 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Flow 'volume_create_manager' (ba19e3fb-18c4-4c07-a895-25a32ed511e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:06:14.739920 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c021e1d9-c607-4596-8569-2a2e168271cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:06:14.783735 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c021e1d9-c607-4596-8569-2a2e168271cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1740660880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a4def1a5-1241-4166-ba58-197ca028172b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4e54075f50e468dbd398cc3df0d30a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:06:15Z,use_quota=True,user_id='317c7fc1b0be4187bb3b719ac5c8fde3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:06:14.793074 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948910ef-8311-43ac-a6e4-d575b7b05660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:06:14.798587 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (948910ef-8311-43ac-a6e4-d575b7b05660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:06:14.805184 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e134c186-9a08-4a9b-a9fc-b2a81ea014a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:06:14.812039 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e134c186-9a08-4a9b-a9fc-b2a81ea014a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4def1a5-1241-4166-ba58-197ca028172b', 'volume_name': 'volume-a4def1a5-1241-4166-ba58-197ca028172b', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:06:14.822531 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d457f63c-18f2-4765-a9ca-99b4da14223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:06:14.829701 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d457f63c-18f2-4765-a9ca-99b4da14223a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:06:14.837739 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0843f7-0210-40dc-876c-a43d53ad717c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:06:14.839125 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Volume a4def1a5-1241-4166-ba58-197ca028172b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4def1a5-1241-4166-ba58-197ca028172b', 'volume_size': 1}
Oct 29 21:06:14.856403 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] creating volume 'volume-a4def1a5-1241-4166-ba58-197ca028172b' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:06:14.857932 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:06:15.076374 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:06:15.076689 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:06:15.080425 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0843f7-0210-40dc-876c-a43d53ad717c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4def1a5-1241-4166-ba58-197ca028172b', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:06:15.085411 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1120f012-ceb0-48c8-9519-5d5bcb5fc95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:06:15.107853 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Volume volume-a4def1a5-1241-4166-ba58-197ca028172b (a4def1a5-1241-4166-ba58-197ca028172b): created successfully
Oct 29 21:06:15.111543 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1120f012-ceb0-48c8-9519-5d5bcb5fc95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:06:15.130707 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Flow 'volume_create_manager' (ba19e3fb-18c4-4c07-a895-25a32ed511e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:06:15.145405 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-72880ec8-657c-49f3-b323-af689a8a2651 tempest-VolumesAdminNegativeTest-775941430 None] Created volume successfully.
Oct 29 21:06:16.482617 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-36b978e6-8423-4597-9d70-3aed4ebb6f26 tempest-VolumesAdminNegativeTest-775941430 None] Acquiring lock "cinder-a4def1a5-1241-4166-ba58-197ca028172b-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:06:16.502403 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-36b978e6-8423-4597-9d70-3aed4ebb6f26 tempest-VolumesAdminNegativeTest-775941430 None] Lock "cinder-a4def1a5-1241-4166-ba58-197ca028172b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:06:16.639706 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-36b978e6-8423-4597-9d70-3aed4ebb6f26 tempest-VolumesAdminNegativeTest-775941430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:06:16.777238 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-36b978e6-8423-4597-9d70-3aed4ebb6f26 tempest-VolumesAdminNegativeTest-775941430 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:06:16.777740 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-36b978e6-8423-4597-9d70-3aed4ebb6f26 tempest-VolumesAdminNegativeTest-775941430 None] Volume volume-a4def1a5-1241-4166-ba58-197ca028172b is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:06:16.787882 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-36b978e6-8423-4597-9d70-3aed4ebb6f26 tempest-VolumesAdminNegativeTest-775941430 None] deleting rbd volume volume-a4def1a5-1241-4166-ba58-197ca028172b {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:06:17.320819 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-36b978e6-8423-4597-9d70-3aed4ebb6f26 tempest-VolumesAdminNegativeTest-775941430 None] Created reservations ['17ba9471-c672-4ec9-af40-4784848e56e2', '0873f4e1-6a18-4fe5-a903-eeb9d2a9ec57', 'd3596b7f-2adf-4015-8106-729abd8dcd8a', '26985e82-1753-4067-b932-7b0386a02aa1'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:06:17.500397 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-36b978e6-8423-4597-9d70-3aed4ebb6f26 tempest-VolumesAdminNegativeTest-775941430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:06:17.602924 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-36b978e6-8423-4597-9d70-3aed4ebb6f26 tempest-VolumesAdminNegativeTest-775941430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:06:17.695601 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-36b978e6-8423-4597-9d70-3aed4ebb6f26 tempest-VolumesAdminNegativeTest-775941430 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:06:17.700720 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-36b978e6-8423-4597-9d70-3aed4ebb6f26 tempest-VolumesAdminNegativeTest-775941430 None] Deleted volume successfully.
Oct 29 21:06:17.727792 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-36b978e6-8423-4597-9d70-3aed4ebb6f26 tempest-VolumesAdminNegativeTest-775941430 None] Lock "cinder-a4def1a5-1241-4166-ba58-197ca028172b-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:06:22.580120 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=21,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:06:26.407755 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-49a7b17e-6e44-41fe-bde3-16ac18d5fe51 tempest-VolumesAdminNegativeTest-775941430 None] Acquiring lock "cinder-4a921766-a21e-4791-bb5f-563fd4150c2a-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:06:26.424643 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-49a7b17e-6e44-41fe-bde3-16ac18d5fe51 tempest-VolumesAdminNegativeTest-775941430 None] Lock "cinder-4a921766-a21e-4791-bb5f-563fd4150c2a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:06:26.512841 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-49a7b17e-6e44-41fe-bde3-16ac18d5fe51 tempest-VolumesAdminNegativeTest-775941430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:06:26.582451 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-49a7b17e-6e44-41fe-bde3-16ac18d5fe51 tempest-VolumesAdminNegativeTest-775941430 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:06:26.584332 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-49a7b17e-6e44-41fe-bde3-16ac18d5fe51 tempest-VolumesAdminNegativeTest-775941430 None] Volume volume-4a921766-a21e-4791-bb5f-563fd4150c2a is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:06:26.600530 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-49a7b17e-6e44-41fe-bde3-16ac18d5fe51 tempest-VolumesAdminNegativeTest-775941430 None] deleting rbd volume volume-4a921766-a21e-4791-bb5f-563fd4150c2a {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:06:26.995939 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-49a7b17e-6e44-41fe-bde3-16ac18d5fe51 tempest-VolumesAdminNegativeTest-775941430 None] Created reservations ['d5772edd-f561-4844-9244-2a63f95da572', 'bef4d6a7-2e25-4369-a03a-1926294c4a1c', '301c5563-4dec-4b0d-82af-6d331be13455', '3e115efd-dcb5-4f93-86d2-8ca5caebd844'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:06:27.086988 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-49a7b17e-6e44-41fe-bde3-16ac18d5fe51 tempest-VolumesAdminNegativeTest-775941430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:06:27.147647 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-49a7b17e-6e44-41fe-bde3-16ac18d5fe51 tempest-VolumesAdminNegativeTest-775941430 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:06:27.255033 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-49a7b17e-6e44-41fe-bde3-16ac18d5fe51 tempest-VolumesAdminNegativeTest-775941430 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:06:27.259423 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-49a7b17e-6e44-41fe-bde3-16ac18d5fe51 tempest-VolumesAdminNegativeTest-775941430 None] Deleted volume successfully.
Oct 29 21:06:27.305393 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-49a7b17e-6e44-41fe-bde3-16ac18d5fe51 tempest-VolumesAdminNegativeTest-775941430 None] Lock "cinder-4a921766-a21e-4791-bb5f-563fd4150c2a-delete_volume" released by "delete_volume" :: held 0.885s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:06:32.593322 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=33,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:07:01.371467 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:07:01.372648 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:07:01.466575 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:07:01.564607 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:07:02.579712 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:07:02.582623 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=16,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:07:20.042966 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:07:20.067995 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Flow 'volume_create_manager' (15751650-44ef-47ac-abc8-7ddcda7db6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:07:20.075060 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143aa872-be17-4d2c-ac34-8c45fd642492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:20.103612 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143aa872-be17-4d2c-ac34-8c45fd642492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1613034269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c40a99ee-b65d-4555-8a47-9a9439c99cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='208de26bb7304ee793bac715fb73fbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:07:20Z,use_quota=True,user_id='04d3c643e9c245eeaa6328d22184bc00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:20.109907 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4126069-c3d6-458b-9434-9eb5cf4671d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:20.114326 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4126069-c3d6-458b-9434-9eb5cf4671d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:20.121120 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab1b238-e00c-454e-ad04-0d2db72caba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:20.125292 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ab1b238-e00c-454e-ad04-0d2db72caba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c40a99ee-b65d-4555-8a47-9a9439c99cae', 'volume_name': 'volume-c40a99ee-b65d-4555-8a47-9a9439c99cae', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:20.131459 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7109d277-ff48-467c-8a8f-3d6e48e346a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:20.135783 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7109d277-ff48-467c-8a8f-3d6e48e346a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:20.141484 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632c9708-6636-49da-b324-7c25098f8ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:20.142832 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Volume c40a99ee-b65d-4555-8a47-9a9439c99cae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c40a99ee-b65d-4555-8a47-9a9439c99cae', 'volume_size': 1}
Oct 29 21:07:20.143498 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] creating volume 'volume-c40a99ee-b65d-4555-8a47-9a9439c99cae' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:07:20.145094 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:07:20.276228 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:07:20.276889 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:07:20.281874 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (632c9708-6636-49da-b324-7c25098f8ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c40a99ee-b65d-4555-8a47-9a9439c99cae', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:20.287209 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5c8233-077f-4221-b088-2f07a022d48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:20.305141 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Volume volume-c40a99ee-b65d-4555-8a47-9a9439c99cae (c40a99ee-b65d-4555-8a47-9a9439c99cae): created successfully
Oct 29 21:07:20.309360 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba5c8233-077f-4221-b088-2f07a022d48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:20.316657 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Flow 'volume_create_manager' (15751650-44ef-47ac-abc8-7ddcda7db6b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:07:20.334453 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-5b3d56da-025b-4454-a1e3-998f27282430 tempest-AttachVolumeTestJSON-984626347 None] Created volume successfully.
Oct 29 21:07:21.804236 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-5e05e71f-e3af-4a7a-bc02-1207a98bc0f4 req-3f8ef6f5-b92d-4359-a03a-4789984af86f tempest-AttachVolumeTestJSON-984626347 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:07:23.244574 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-5e05e71f-e3af-4a7a-bc02-1207a98bc0f4 req-3f8ef6f5-b92d-4359-a03a-4789984af86f tempest-AttachVolumeTestJSON-984626347 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.440s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:07:23.246367 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-5e05e71f-e3af-4a7a-bc02-1207a98bc0f4 req-3f8ef6f5-b92d-4359-a03a-4789984af86f tempest-AttachVolumeTestJSON-984626347 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c40a99ee-b65d-4555-8a47-9a9439c99cae', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'c40a99ee-b65d-4555-8a47-9a9439c99cae', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:07:23.290064 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-5e05e71f-e3af-4a7a-bc02-1207a98bc0f4 req-3f8ef6f5-b92d-4359-a03a-4789984af86f tempest-AttachVolumeTestJSON-984626347 None] Connection info returned from driver {'name': 'volumes/volume-c40a99ee-b65d-4555-8a47-9a9439c99cae', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c40a99ee-b65d-4555-8a47-9a9439c99cae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '18732699-3aa3-46bc-a49e-16435a4da4b9'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:07:23.406254 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-5e05e71f-e3af-4a7a-bc02-1207a98bc0f4 req-3f8ef6f5-b92d-4359-a03a-4789984af86f tempest-AttachVolumeTestJSON-984626347 None] attachment_update completed successfully.
Oct 29 21:07:31.992480 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1aef5428-98c8-4c64-a092-dc227c3da013 tempest-GroupSnapshotsV319Test-2000528734 None] Group tempest-GroupSnapshotsV319Test-Group-1564736977: creating
Oct 29 21:07:32.028859 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1aef5428-98c8-4c64-a092-dc227c3da013 tempest-GroupSnapshotsV319Test-2000528734 None] Group tempest-GroupSnapshotsV319Test-Group-1564736977: created successfully
Oct 29 21:07:32.038575 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1aef5428-98c8-4c64-a092-dc227c3da013 tempest-GroupSnapshotsV319Test-2000528734 None] Create group completed successfully.
Oct 29 21:07:32.593065 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=26,cinder:UPDATE=7 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:07:33.660322 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:07:33.690218 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Flow 'volume_create_manager' (65657126-5e4b-4a04-b1ba-9520c601caf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:07:33.702763 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf499a0-fa4c-4d9a-9b52-b94470d15ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:33.739288 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf499a0-fa4c-4d9a-9b52-b94470d15ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-635156000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=17d58fab-cc7a-4c61-a691-94ea31b96262,host='ncdv-master-1@ceph#ceph',id=c3eaeced-f443-4b7f-a1dd-55d71a735433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f251a662d83a4c74bd8601395b610c5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:07:34Z,use_quota=True,user_id='15a2cbde18ed436cbdc4f5c9b5097a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93638667-5ae2-4808-9685-e7291648f75e),volume_type_id=93638667-5ae2-4808-9685-e7291648f75e)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:33.778003 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60bf1782-08fc-4554-94d0-4eca9aa0d4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:33.791082 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60bf1782-08fc-4554-94d0-4eca9aa0d4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:33.804453 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a6dcea-3bb9-46bd-8c64-6e693fbf1e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:33.808637 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a6dcea-3bb9-46bd-8c64-6e693fbf1e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3eaeced-f443-4b7f-a1dd-55d71a735433', 'volume_name': 'volume-c3eaeced-f443-4b7f-a1dd-55d71a735433', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:33.813530 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86077039-b13a-4e76-8e98-e205182bd1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:33.818284 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86077039-b13a-4e76-8e98-e205182bd1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:33.839741 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2591589-889c-412b-b5d2-5177ce13d94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:33.841178 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Volume c3eaeced-f443-4b7f-a1dd-55d71a735433: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3eaeced-f443-4b7f-a1dd-55d71a735433', 'volume_size': 1}
Oct 29 21:07:33.842124 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] creating volume 'volume-c3eaeced-f443-4b7f-a1dd-55d71a735433' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:07:33.843083 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:07:33.954274 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] extra_specs: {} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:07:33.954656 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] extra_specs: {} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:07:33.958989 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2591589-889c-412b-b5d2-5177ce13d94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3eaeced-f443-4b7f-a1dd-55d71a735433', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:33.970963 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2746b2e1-8982-4a47-a84f-f8e19b2b204d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:33.986646 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Volume volume-c3eaeced-f443-4b7f-a1dd-55d71a735433 (c3eaeced-f443-4b7f-a1dd-55d71a735433): created successfully
Oct 29 21:07:33.992530 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2746b2e1-8982-4a47-a84f-f8e19b2b204d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:33.998953 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Flow 'volume_create_manager' (65657126-5e4b-4a04-b1ba-9520c601caf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:07:34.013697 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-59e637e3-672c-47cf-bef1-a66f3a11f1bf tempest-GroupSnapshotsV319Test-2000528734 None] Created volume successfully.
Oct 29 21:07:35.147492 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f81ffbaf-9c25-4217-9b16-0ca6076c0f1c tempest-GroupSnapshotsV319Test-2000528734 None] GroupSnapshot 65dbdea5-9a28-4e55-9cdd-d26418b0e526: creating.
Oct 29 21:07:35.197295 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f81ffbaf-9c25-4217-9b16-0ca6076c0f1c tempest-GroupSnapshotsV319Test-2000528734 None] Group snapshot 65dbdea5-9a28-4e55-9cdd-d26418b0e526: creating. {{(pid=131780) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Oct 29 21:07:35.216642 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f81ffbaf-9c25-4217-9b16-0ca6076c0f1c tempest-GroupSnapshotsV319Test-2000528734 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:07:36.422825 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f81ffbaf-9c25-4217-9b16-0ca6076c0f1c tempest-GroupSnapshotsV319Test-2000528734 None] group_snapshot 65dbdea5-9a28-4e55-9cdd-d26418b0e526: created successfully
Oct 29 21:07:38.039237 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-9a498f05-b77c-47f5-9b8c-3d47dc782c2e tempest-GroupSnapshotsV319Test-2000528734 None] group_snapshot 65dbdea5-9a28-4e55-9cdd-d26418b0e526: deleting
Oct 29 21:07:38.071891 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-9a498f05-b77c-47f5-9b8c-3d47dc782c2e tempest-GroupSnapshotsV319Test-2000528734 None] group_snapshot 65dbdea5-9a28-4e55-9cdd-d26418b0e526: deleting {{(pid=131780) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Oct 29 21:07:38.090895 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9a498f05-b77c-47f5-9b8c-3d47dc782c2e tempest-GroupSnapshotsV319Test-2000528734 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:07:38.448199 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-9a498f05-b77c-47f5-9b8c-3d47dc782c2e tempest-GroupSnapshotsV319Test-2000528734 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-510672778 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-510672778, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:07:38.449247 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-9a498f05-b77c-47f5-9b8c-3d47dc782c2e tempest-GroupSnapshotsV319Test-2000528734 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-510672778 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-510672778, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:07:38.483967 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-9a498f05-b77c-47f5-9b8c-3d47dc782c2e tempest-GroupSnapshotsV319Test-2000528734 None] Created reservations ['2d9e1bcf-4153-4bd8-8f80-2e619bf8cbe5', 'bd86c581-6cb7-4d5e-a3b2-02a48d54bcd6', '3ca5851a-ba9d-4a62-ab30-d50385a796a1', 'e4c648cc-e217-49aa-ae21-90f9432c53cd'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:07:38.536220 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-9a498f05-b77c-47f5-9b8c-3d47dc782c2e tempest-GroupSnapshotsV319Test-2000528734 None] group_snapshot 65dbdea5-9a28-4e55-9cdd-d26418b0e526: deleted successfully
Oct 29 21:07:39.833076 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a04867cb-2366-4531-8fcb-ecfe97f7a769 tempest-GroupSnapshotsV319Test-2000528734 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:07:39.906307 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a04867cb-2366-4531-8fcb-ecfe97f7a769 tempest-GroupSnapshotsV319Test-2000528734 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:07:39.907388 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a04867cb-2366-4531-8fcb-ecfe97f7a769 tempest-GroupSnapshotsV319Test-2000528734 None] Volume volume-c3eaeced-f443-4b7f-a1dd-55d71a735433 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:07:39.914198 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a04867cb-2366-4531-8fcb-ecfe97f7a769 tempest-GroupSnapshotsV319Test-2000528734 None] deleting rbd volume volume-c3eaeced-f443-4b7f-a1dd-55d71a735433 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:07:40.291130 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-a04867cb-2366-4531-8fcb-ecfe97f7a769 tempest-GroupSnapshotsV319Test-2000528734 None] Created reservations ['cfb641a1-65da-4446-a033-862b9236e3d3'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:07:40.345934 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-a04867cb-2366-4531-8fcb-ecfe97f7a769 tempest-GroupSnapshotsV319Test-2000528734 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-510672778 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-510672778, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:07:40.402291 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-a04867cb-2366-4531-8fcb-ecfe97f7a769 tempest-GroupSnapshotsV319Test-2000528734 None] Created reservations ['d17e1e05-d0dd-4494-b066-4d9bfbe3a97d', 'b5748d91-5121-4940-b23c-62e7b08ec64d', '16669f19-abba-4c3d-a2ec-77516de291e1', 'cf7aa7aa-da78-469d-9e7c-b45436f3a236'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:07:40.487153 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=68,cinder:UPDATE=25,cinder:DELETE=1,cinder:INSERT=6 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:07:40.526050 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a04867cb-2366-4531-8fcb-ecfe97f7a769 tempest-GroupSnapshotsV319Test-2000528734 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:07:40.586145 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a04867cb-2366-4531-8fcb-ecfe97f7a769 tempest-GroupSnapshotsV319Test-2000528734 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:07:40.677710 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-a04867cb-2366-4531-8fcb-ecfe97f7a769 tempest-GroupSnapshotsV319Test-2000528734 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:07:40.682369 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a04867cb-2366-4531-8fcb-ecfe97f7a769 tempest-GroupSnapshotsV319Test-2000528734 None] Delete group completed successfully.
Oct 29 21:07:52.609093 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:07:55.887518 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-adc7f76b-5a54-454c-aa09-1120da2ba7bc tempest-GroupsV314Test-1740345876 None] Group tempest-GroupsV314Test-Group-1626473152: creating
Oct 29 21:07:55.916667 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-adc7f76b-5a54-454c-aa09-1120da2ba7bc tempest-GroupsV314Test-1740345876 None] Group tempest-GroupsV314Test-Group-1626473152: created successfully
Oct 29 21:07:55.931590 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-adc7f76b-5a54-454c-aa09-1120da2ba7bc tempest-GroupsV314Test-1740345876 None] Create group completed successfully.
Oct 29 21:07:57.903708 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:07:57.953583 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Flow 'volume_create_manager' (cafbc07d-1e98-4fbc-bd23-d6aa5f06b453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:07:57.976434 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a465ed88-3d04-404d-b424-290a97eb158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:58.012546 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a465ed88-3d04-404d-b424-290a97eb158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-472197787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=52b4b6f4-6662-4665-a5d6-eccee2b5c589,host='ncdv-master-1@ceph#ceph',id=4c95ea3d-67aa-4e05-b4ee-09b66fdd273c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d128383c5b4f888ff648450502a7e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:07:58Z,use_quota=True,user_id='917e53252caa4859aadf8a74c81bd4af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d04dda55-5eaa-4a7c-83d9-5d920326b4ec),volume_type_id=d04dda55-5eaa-4a7c-83d9-5d920326b4ec)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:58.020127 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c633f947-9a80-4660-b848-29401d5f5df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:58.025024 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c633f947-9a80-4660-b848-29401d5f5df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:58.046187 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2be5361-7c6a-484c-974c-fc1656a29c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:58.051484 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2be5361-7c6a-484c-974c-fc1656a29c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c95ea3d-67aa-4e05-b4ee-09b66fdd273c', 'volume_name': 'volume-4c95ea3d-67aa-4e05-b4ee-09b66fdd273c', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:58.058047 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fbc451-fa05-436d-8523-10ac1ae3a1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:58.061989 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fbc451-fa05-436d-8523-10ac1ae3a1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:58.066669 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735d0f5d-88c5-434e-8b5e-6695d3d50649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:58.067809 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Volume 4c95ea3d-67aa-4e05-b4ee-09b66fdd273c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c95ea3d-67aa-4e05-b4ee-09b66fdd273c', 'volume_size': 1}
Oct 29 21:07:58.068209 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] creating volume 'volume-4c95ea3d-67aa-4e05-b4ee-09b66fdd273c' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:07:58.068974 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:07:58.200366 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] extra_specs: {} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:07:58.201202 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] extra_specs: {} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:07:58.205505 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735d0f5d-88c5-434e-8b5e-6695d3d50649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c95ea3d-67aa-4e05-b4ee-09b66fdd273c', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:58.213122 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed480a0-a9d6-41d9-8a72-a051b3726472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:07:58.242306 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Volume volume-4c95ea3d-67aa-4e05-b4ee-09b66fdd273c (4c95ea3d-67aa-4e05-b4ee-09b66fdd273c): created successfully
Oct 29 21:07:58.254589 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed480a0-a9d6-41d9-8a72-a051b3726472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:07:58.266600 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Flow 'volume_create_manager' (cafbc07d-1e98-4fbc-bd23-d6aa5f06b453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:07:58.285950 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a14173a2-ce8e-45ee-90e4-9a926161cc82 tempest-GroupsV314Test-1740345876 None] Created volume successfully.
Oct 29 21:07:59.819938 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-38158e85-5e4c-4246-9112-cb343774ff52 tempest-GroupsV314Test-1740345876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:07:59.902505 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-38158e85-5e4c-4246-9112-cb343774ff52 tempest-GroupsV314Test-1740345876 None] creating snapshot='volume-7e82b485-fdb2-496d-bdd0-acf16b02249a.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 21:08:00.413609 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-38158e85-5e4c-4246-9112-cb343774ff52 tempest-GroupsV314Test-1740345876 None] cloning 'volume-4c95ea3d-67aa-4e05-b4ee-09b66fdd273c@volume-7e82b485-fdb2-496d-bdd0-acf16b02249a.clone_snap' to 'volume-7e82b485-fdb2-496d-bdd0-acf16b02249a' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 21:08:00.543389 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-38158e85-5e4c-4246-9112-cb343774ff52 tempest-GroupsV314Test-1740345876 None] Volume volume-4c95ea3d-67aa-4e05-b4ee-09b66fdd273c is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:08:00.554127 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-38158e85-5e4c-4246-9112-cb343774ff52 tempest-GroupsV314Test-1740345876 None] extra_specs: {} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:08:00.555119 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-38158e85-5e4c-4246-9112-cb343774ff52 tempest-GroupsV314Test-1740345876 None] extra_specs: {} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:08:00.578226 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-38158e85-5e4c-4246-9112-cb343774ff52 tempest-GroupsV314Test-1740345876 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 21:08:00.663064 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-38158e85-5e4c-4246-9112-cb343774ff52 tempest-GroupsV314Test-1740345876 None] Create group from source-group-52b4b6f4-6662-4665-a5d6-eccee2b5c589 completed successfully.
Oct 29 21:08:01.370832 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:08:01.373024 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:01.483003 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:01.614916 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:08:01.643361 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=70,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:08:01.669825 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2b226ce6-19d3-4f9f-b8e7-9f3779c444a8 tempest-GroupsV314Test-1740345876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:01.772767 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2b226ce6-19d3-4f9f-b8e7-9f3779c444a8 tempest-GroupsV314Test-1740345876 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:08:01.783505 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2b226ce6-19d3-4f9f-b8e7-9f3779c444a8 tempest-GroupsV314Test-1740345876 None] deleting rbd volume volume-7e82b485-fdb2-496d-bdd0-acf16b02249a {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:08:02.108305 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2b226ce6-19d3-4f9f-b8e7-9f3779c444a8 tempest-GroupsV314Test-1740345876 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 21:08:02.134657 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2b226ce6-19d3-4f9f-b8e7-9f3779c444a8 tempest-GroupsV314Test-1740345876 None] Volume volume-4c95ea3d-67aa-4e05-b4ee-09b66fdd273c is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:08:02.135491 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2b226ce6-19d3-4f9f-b8e7-9f3779c444a8 tempest-GroupsV314Test-1740345876 None] deleting parent snapshot volume-7e82b485-fdb2-496d-bdd0-acf16b02249a.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 21:08:02.620441 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-2b226ce6-19d3-4f9f-b8e7-9f3779c444a8 tempest-GroupsV314Test-1740345876 None] Created reservations ['05073a73-f451-45f2-8152-645a6ae8eb96'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:08:02.643258 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-2b226ce6-19d3-4f9f-b8e7-9f3779c444a8 tempest-GroupsV314Test-1740345876 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-774592448 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-774592448, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:08:02.644647 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-2b226ce6-19d3-4f9f-b8e7-9f3779c444a8 tempest-GroupsV314Test-1740345876 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-774592448 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-774592448, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:08:02.664911 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-2b226ce6-19d3-4f9f-b8e7-9f3779c444a8 tempest-GroupsV314Test-1740345876 None] Created reservations ['e5fb89b0-1b1d-4964-829c-08c5394e1abe', '6a85ddd7-76e5-4b0f-96c7-41c2ee56c36b', '5eef3ac3-e88c-4c85-847b-248de5be8693', 'ab3512f6-b487-4951-99cf-2727b5267bd4'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:08:02.834124 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2b226ce6-19d3-4f9f-b8e7-9f3779c444a8 tempest-GroupsV314Test-1740345876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:02.880751 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2b226ce6-19d3-4f9f-b8e7-9f3779c444a8 tempest-GroupsV314Test-1740345876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:02.943117 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-2b226ce6-19d3-4f9f-b8e7-9f3779c444a8 tempest-GroupsV314Test-1740345876 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:08:02.951124 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-2b226ce6-19d3-4f9f-b8e7-9f3779c444a8 tempest-GroupsV314Test-1740345876 None] Delete group completed successfully.
Oct 29 21:08:03.335102 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0342c58a-51cc-4643-8377-4846af445518 tempest-GroupsV314Test-1740345876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:03.491522 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0342c58a-51cc-4643-8377-4846af445518 tempest-GroupsV314Test-1740345876 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:08:03.491522 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0342c58a-51cc-4643-8377-4846af445518 tempest-GroupsV314Test-1740345876 None] Volume volume-4c95ea3d-67aa-4e05-b4ee-09b66fdd273c is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:08:03.501754 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0342c58a-51cc-4643-8377-4846af445518 tempest-GroupsV314Test-1740345876 None] deleting rbd volume volume-4c95ea3d-67aa-4e05-b4ee-09b66fdd273c {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:08:03.953905 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-0342c58a-51cc-4643-8377-4846af445518 tempest-GroupsV314Test-1740345876 None] Created reservations ['947acdd7-7eb9-4252-aef3-519095064d8e'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:08:04.024799 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-0342c58a-51cc-4643-8377-4846af445518 tempest-GroupsV314Test-1740345876 None] Created reservations ['8f0b0487-8e35-4617-87db-3578f72c80ff', '50377498-422f-44db-808b-26ca12684955', '426f47eb-6571-401d-a827-257dc3b082af', '28e95cdc-baab-441f-a8e9-8f9e793df2cd'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:08:04.236146 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0342c58a-51cc-4643-8377-4846af445518 tempest-GroupsV314Test-1740345876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:04.328070 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0342c58a-51cc-4643-8377-4846af445518 tempest-GroupsV314Test-1740345876 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:04.410767 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-0342c58a-51cc-4643-8377-4846af445518 tempest-GroupsV314Test-1740345876 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:08:04.418368 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-0342c58a-51cc-4643-8377-4846af445518 tempest-GroupsV314Test-1740345876 None] Delete group completed successfully.
Oct 29 21:08:10.955044 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-320db44a-bb2b-46b3-867e-77308829571e tempest-DeleteServersTestJSON-860327279 None] Acquiring lock "cinder-d0a58bc7-10e3-494c-b645-6c64967586b9-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:08:10.971742 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-320db44a-bb2b-46b3-867e-77308829571e tempest-DeleteServersTestJSON-860327279 None] Lock "cinder-d0a58bc7-10e3-494c-b645-6c64967586b9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:08:11.043014 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-320db44a-bb2b-46b3-867e-77308829571e tempest-DeleteServersTestJSON-860327279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:11.098617 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-320db44a-bb2b-46b3-867e-77308829571e tempest-DeleteServersTestJSON-860327279 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:08:11.099353 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-320db44a-bb2b-46b3-867e-77308829571e tempest-DeleteServersTestJSON-860327279 None] Volume volume-d0a58bc7-10e3-494c-b645-6c64967586b9 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:08:11.109693 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-320db44a-bb2b-46b3-867e-77308829571e tempest-DeleteServersTestJSON-860327279 None] deleting rbd volume volume-d0a58bc7-10e3-494c-b645-6c64967586b9 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:08:11.303954 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-bad7fff5-9359-4571-92fc-def012e2669b tempest-ServersNegativeTestJSON-1286545161 None] Acquiring lock "cinder-41e8bc52-fb85-4a77-b392-bddd056f4bc8-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:08:11.327139 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-bad7fff5-9359-4571-92fc-def012e2669b tempest-ServersNegativeTestJSON-1286545161 None] Lock "cinder-41e8bc52-fb85-4a77-b392-bddd056f4bc8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:08:11.408089 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bad7fff5-9359-4571-92fc-def012e2669b tempest-ServersNegativeTestJSON-1286545161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:11.530218 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bad7fff5-9359-4571-92fc-def012e2669b tempest-ServersNegativeTestJSON-1286545161 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:08:11.532625 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bad7fff5-9359-4571-92fc-def012e2669b tempest-ServersNegativeTestJSON-1286545161 None] Volume volume-41e8bc52-fb85-4a77-b392-bddd056f4bc8 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:08:11.547870 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bad7fff5-9359-4571-92fc-def012e2669b tempest-ServersNegativeTestJSON-1286545161 None] deleting rbd volume volume-41e8bc52-fb85-4a77-b392-bddd056f4bc8 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:08:11.568691 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=70,cinder:UPDATE=25,cinder:INSERT=5 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:08:11.662071 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-320db44a-bb2b-46b3-867e-77308829571e tempest-DeleteServersTestJSON-860327279 None] Created reservations ['ccb0d31a-e06d-4419-8951-d62f0677b2b2', 'd79b7647-8ad9-40cc-ab82-beb3252e6120', 'c521124b-e293-45b8-88c2-84a4a9778481', 'abf10431-f91f-4f99-a928-f4a72cabe950'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:08:11.755283 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-320db44a-bb2b-46b3-867e-77308829571e tempest-DeleteServersTestJSON-860327279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:11.820894 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-320db44a-bb2b-46b3-867e-77308829571e tempest-DeleteServersTestJSON-860327279 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:11.899680 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-320db44a-bb2b-46b3-867e-77308829571e tempest-DeleteServersTestJSON-860327279 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:08:11.935837 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-320db44a-bb2b-46b3-867e-77308829571e tempest-DeleteServersTestJSON-860327279 None] Deleted volume successfully.
Oct 29 21:08:11.968538 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-320db44a-bb2b-46b3-867e-77308829571e tempest-DeleteServersTestJSON-860327279 None] Lock "cinder-d0a58bc7-10e3-494c-b645-6c64967586b9-delete_volume" released by "delete_volume" :: held 0.997s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:08:11.985227 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-bad7fff5-9359-4571-92fc-def012e2669b tempest-ServersNegativeTestJSON-1286545161 None] Created reservations ['a7aef4f2-ee6d-474f-b4f7-b75d5d7df0a3', 'b64ff82d-a29b-4f22-9c0c-90da7d9040a5', 'b39649a2-f928-4c76-b614-3b530e286a98', '9ee8f99f-57f7-4485-bcd1-bdfd08cdac51'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:08:11.998742 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=55,cinder:UPDATE=35,cinder:INSERT=10 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:08:12.033241 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bad7fff5-9359-4571-92fc-def012e2669b tempest-ServersNegativeTestJSON-1286545161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:12.076050 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bad7fff5-9359-4571-92fc-def012e2669b tempest-ServersNegativeTestJSON-1286545161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:12.138230 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-bad7fff5-9359-4571-92fc-def012e2669b tempest-ServersNegativeTestJSON-1286545161 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:08:12.149818 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-bad7fff5-9359-4571-92fc-def012e2669b tempest-ServersNegativeTestJSON-1286545161 None] Deleted volume successfully.
Oct 29 21:08:12.171516 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-bad7fff5-9359-4571-92fc-def012e2669b tempest-ServersNegativeTestJSON-1286545161 None] Lock "cinder-41e8bc52-fb85-4a77-b392-bddd056f4bc8-delete_volume" released by "delete_volume" :: held 0.853s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:08:12.594805 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-fd341928-a559-4ccb-8336-0f32893c1f34 tempest-ServersNegativeTestJSON-1286545161 None] Acquiring lock "cinder-6795ea29-e00f-4ecb-b9e9-c60c491b9c9d-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:08:12.652245 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-fd341928-a559-4ccb-8336-0f32893c1f34 tempest-ServersNegativeTestJSON-1286545161 None] Lock "cinder-6795ea29-e00f-4ecb-b9e9-c60c491b9c9d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:08:12.721012 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fd341928-a559-4ccb-8336-0f32893c1f34 tempest-ServersNegativeTestJSON-1286545161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:12.769748 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fd341928-a559-4ccb-8336-0f32893c1f34 tempest-ServersNegativeTestJSON-1286545161 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:08:12.770205 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fd341928-a559-4ccb-8336-0f32893c1f34 tempest-ServersNegativeTestJSON-1286545161 None] Volume volume-6795ea29-e00f-4ecb-b9e9-c60c491b9c9d is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:08:12.778222 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fd341928-a559-4ccb-8336-0f32893c1f34 tempest-ServersNegativeTestJSON-1286545161 None] deleting rbd volume volume-6795ea29-e00f-4ecb-b9e9-c60c491b9c9d {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:08:13.117041 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-fd341928-a559-4ccb-8336-0f32893c1f34 tempest-ServersNegativeTestJSON-1286545161 None] Created reservations ['8ac14251-114d-416f-b567-e910a38e31ee', 'b410678c-cbfc-457c-9ca4-556d4ca1c6c7', 'df4f87db-d894-4859-8fa1-f8bfc154d4b7', '405281af-b63f-4de2-b7b5-10e82b0c1538'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:08:13.193075 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fd341928-a559-4ccb-8336-0f32893c1f34 tempest-ServersNegativeTestJSON-1286545161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:13.270144 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fd341928-a559-4ccb-8336-0f32893c1f34 tempest-ServersNegativeTestJSON-1286545161 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:13.344410 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-fd341928-a559-4ccb-8336-0f32893c1f34 tempest-ServersNegativeTestJSON-1286545161 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:08:13.350923 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-fd341928-a559-4ccb-8336-0f32893c1f34 tempest-ServersNegativeTestJSON-1286545161 None] Deleted volume successfully.
Oct 29 21:08:13.366392 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-fd341928-a559-4ccb-8336-0f32893c1f34 tempest-ServersNegativeTestJSON-1286545161 None] Lock "cinder-6795ea29-e00f-4ecb-b9e9-c60c491b9c9d-delete_volume" released by "delete_volume" :: held 0.714s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:08:16.060558 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-f54f9673-9011-40bf-8693-518b482099b0 req-5f8601da-1680-42a6-bcae-d5aaf067031e tempest-AttachVolumeTestJSON-984626347 None] Terminate volume connection completed successfully.
Oct 29 21:08:16.062004 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-f54f9673-9011-40bf-8693-518b482099b0 req-5f8601da-1680-42a6-bcae-d5aaf067031e tempest-AttachVolumeTestJSON-984626347 None] Deleting attachment 18732699-3aa3-46bc-a49e-16435a4da4b9. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:08:23.073971 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:08:23.118739 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Flow 'volume_create_manager' (5e17fb5a-bddd-455d-a3b4-60d0ccfced46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:08:23.126055 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97255935-4a2d-43ff-ba0d-cb799b6228f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:23.147291 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97255935-4a2d-43ff-ba0d-cb799b6228f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-295854073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9cf2d160-44a2-43e8-8350-8003bc894a74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62bf9892e2624838a0d50815fefddac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:08:23Z,use_quota=True,user_id='b1fc49b989e443f497f80001937cb457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:23.154723 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d071fed-caae-4e4a-a533-8725964147fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:23.161359 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d071fed-caae-4e4a-a533-8725964147fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:23.166658 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f375a0-7c24-4fd3-80fd-ea5550a8daec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:23.171743 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f375a0-7c24-4fd3-80fd-ea5550a8daec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cf2d160-44a2-43e8-8350-8003bc894a74', 'volume_name': 'volume-9cf2d160-44a2-43e8-8350-8003bc894a74', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:23.177858 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1532fb-b4f3-4c65-9442-68becb274239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:23.181777 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1532fb-b4f3-4c65-9442-68becb274239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:23.187533 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52866812-1ea4-4969-ab77-834f0c9c970a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:23.189370 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Volume 9cf2d160-44a2-43e8-8350-8003bc894a74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cf2d160-44a2-43e8-8350-8003bc894a74', 'volume_size': 1}
Oct 29 21:08:23.191712 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] creating volume 'volume-9cf2d160-44a2-43e8-8350-8003bc894a74' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:08:23.192704 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:23.351602 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:08:23.352579 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:08:23.357105 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52866812-1ea4-4969-ab77-834f0c9c970a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cf2d160-44a2-43e8-8350-8003bc894a74', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:23.368126 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e245252d-56b8-4eda-8f31-da864afe138a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:23.386035 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Volume volume-9cf2d160-44a2-43e8-8350-8003bc894a74 (9cf2d160-44a2-43e8-8350-8003bc894a74): created successfully
Oct 29 21:08:23.392102 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e245252d-56b8-4eda-8f31-da864afe138a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:23.412596 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Flow 'volume_create_manager' (5e17fb5a-bddd-455d-a3b4-60d0ccfced46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:08:23.452289 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-5b6970b0-5056-49ce-a406-ee6adc37ac8e tempest-VolumesListAdminTestJSON-781956204 None] Created volume successfully.
Oct 29 21:08:24.676807 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:08:24.716016 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Flow 'volume_create_manager' (3651d581-9d17-4d9b-a2d6-4d26b94221f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:08:24.723168 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69deccb-5b35-499e-8caa-5f7f502c21c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:24.743723 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69deccb-5b35-499e-8caa-5f7f502c21c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-484744121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4b1a4209-1328-4a36-9f2b-5e109e498f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62bf9892e2624838a0d50815fefddac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:08:25Z,use_quota=True,user_id='b1fc49b989e443f497f80001937cb457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:24.749974 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064a6b40-3caa-46de-9dde-ff47159c748b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:24.755953 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064a6b40-3caa-46de-9dde-ff47159c748b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:24.762233 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74d6c57-6c3e-4064-a7fe-c82e0eed1bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:24.766542 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74d6c57-6c3e-4064-a7fe-c82e0eed1bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b1a4209-1328-4a36-9f2b-5e109e498f02', 'volume_name': 'volume-4b1a4209-1328-4a36-9f2b-5e109e498f02', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:24.772203 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d85355-1d63-49a2-bc29-d2c5c2e01f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:24.777162 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d85355-1d63-49a2-bc29-d2c5c2e01f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:24.782744 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f9afed-4011-48ff-96ed-de90903342a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:24.784199 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Volume 4b1a4209-1328-4a36-9f2b-5e109e498f02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b1a4209-1328-4a36-9f2b-5e109e498f02', 'volume_size': 1}
Oct 29 21:08:24.784597 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] creating volume 'volume-4b1a4209-1328-4a36-9f2b-5e109e498f02' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:08:24.785243 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:24.880721 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:08:24.881777 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:08:24.886934 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f9afed-4011-48ff-96ed-de90903342a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b1a4209-1328-4a36-9f2b-5e109e498f02', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:24.892820 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8fb097-bf3b-4f7f-b477-5a39d3507e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:24.904424 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Volume volume-4b1a4209-1328-4a36-9f2b-5e109e498f02 (4b1a4209-1328-4a36-9f2b-5e109e498f02): created successfully
Oct 29 21:08:24.910180 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8fb097-bf3b-4f7f-b477-5a39d3507e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:24.918269 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Flow 'volume_create_manager' (3651d581-9d17-4d9b-a2d6-4d26b94221f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:08:24.933984 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-3ebc8cde-0a7d-4f96-aeee-d206a906df19 tempest-VolumesListAdminTestJSON-781956204 None] Created volume successfully.
Oct 29 21:08:26.416701 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:08:26.438713 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Flow 'volume_create_manager' (70462295-3a65-49ff-9e67-fa37d2bc2020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:08:26.456377 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d640ea87-c829-4a29-be6a-43934df590c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:26.492226 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d640ea87-c829-4a29-be6a-43934df590c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-264709485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=dd42d196-1f04-49a5-90c7-4cda3723c906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62bf9892e2624838a0d50815fefddac6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:08:26Z,use_quota=True,user_id='b1fc49b989e443f497f80001937cb457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:26.506193 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e3fa2e-98d1-4e11-95ee-fa436934c893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:26.511613 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6e3fa2e-98d1-4e11-95ee-fa436934c893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:26.534150 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966834cb-8aef-4816-9d8b-b02f83e10dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:26.538253 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966834cb-8aef-4816-9d8b-b02f83e10dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd42d196-1f04-49a5-90c7-4cda3723c906', 'volume_name': 'volume-dd42d196-1f04-49a5-90c7-4cda3723c906', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:26.546980 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57df0dc3-62c1-4d5e-a519-7e8731ac5896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:26.551168 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57df0dc3-62c1-4d5e-a519-7e8731ac5896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:26.556016 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e87f200-2643-4967-aae3-5246fa4f8cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:26.557303 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Volume dd42d196-1f04-49a5-90c7-4cda3723c906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd42d196-1f04-49a5-90c7-4cda3723c906', 'volume_size': 1}
Oct 29 21:08:26.557877 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] creating volume 'volume-dd42d196-1f04-49a5-90c7-4cda3723c906' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:08:26.558681 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:26.686072 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:08:26.686768 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:08:26.690894 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e87f200-2643-4967-aae3-5246fa4f8cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd42d196-1f04-49a5-90c7-4cda3723c906', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:26.695381 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51abf571-6971-4acf-bb6a-d395784f2909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:26.723169 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Volume volume-dd42d196-1f04-49a5-90c7-4cda3723c906 (dd42d196-1f04-49a5-90c7-4cda3723c906): created successfully
Oct 29 21:08:26.726975 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51abf571-6971-4acf-bb6a-d395784f2909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:26.735183 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Flow 'volume_create_manager' (70462295-3a65-49ff-9e67-fa37d2bc2020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:08:26.754755 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7195909d-67ea-463e-a641-0dd8a5076e27 tempest-VolumesListAdminTestJSON-781956204 None] Created volume successfully.
Oct 29 21:08:28.764359 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:08:28.802062 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Flow 'volume_create_manager' (05687dda-c367-4312-9c0a-b4a3995ccdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:08:28.820183 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ecff10-01c8-43a9-bf97-f255907f7f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:28.842804 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ecff10-01c8-43a9-bf97-f255907f7f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=33e7b954-cc27-44ee-a975-55dc0f98d58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77b3669b11d408c9a9313f4e2ee8f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:08:29Z,use_quota=True,user_id='34fcca480ac745d09c9c0c0741a053b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:28.848700 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86a871b-f250-429d-90c3-f83b53952ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:28.854189 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86a871b-f250-429d-90c3-f83b53952ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:28.860037 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90c7e83-8385-4e76-8754-55f98b008f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:28.865446 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b90c7e83-8385-4e76-8754-55f98b008f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33e7b954-cc27-44ee-a975-55dc0f98d58e', 'volume_name': 'volume-33e7b954-cc27-44ee-a975-55dc0f98d58e', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:28.877155 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11515cdc-46da-4001-9e51-7a17b27217e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:28.882340 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11515cdc-46da-4001-9e51-7a17b27217e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:28.888700 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea3f867-ccbf-4651-9123-7fcce55c44c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:28.890606 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Volume 33e7b954-cc27-44ee-a975-55dc0f98d58e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33e7b954-cc27-44ee-a975-55dc0f98d58e', 'volume_size': 1}
Oct 29 21:08:28.891560 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] creating volume 'volume-33e7b954-cc27-44ee-a975-55dc0f98d58e' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:08:28.892565 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:29.018656 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:08:29.019098 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:08:29.031165 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea3f867-ccbf-4651-9123-7fcce55c44c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33e7b954-cc27-44ee-a975-55dc0f98d58e', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:29.031431 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd166754-7a58-4170-b4e2-272ce2e52bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:29.057038 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Volume volume-33e7b954-cc27-44ee-a975-55dc0f98d58e (33e7b954-cc27-44ee-a975-55dc0f98d58e): created successfully
Oct 29 21:08:29.068347 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd166754-7a58-4170-b4e2-272ce2e52bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:29.074668 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Flow 'volume_create_manager' (05687dda-c367-4312-9c0a-b4a3995ccdb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:08:29.098871 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-e1ef5c60-162d-4fb8-a541-0127c3c7fb0d tempest-VolumesListAdminTestJSON-1340800476 None] Created volume successfully.
Oct 29 21:08:29.903060 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-fc29243f-61da-4b53-8054-14e86a71b762 tempest-VolumesListAdminTestJSON-1340800476 None] Acquiring lock "cinder-33e7b954-cc27-44ee-a975-55dc0f98d58e-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:08:29.943546 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-fc29243f-61da-4b53-8054-14e86a71b762 tempest-VolumesListAdminTestJSON-1340800476 None] Lock "cinder-33e7b954-cc27-44ee-a975-55dc0f98d58e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:08:30.036603 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fc29243f-61da-4b53-8054-14e86a71b762 tempest-VolumesListAdminTestJSON-1340800476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:30.151293 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fc29243f-61da-4b53-8054-14e86a71b762 tempest-VolumesListAdminTestJSON-1340800476 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:08:30.151734 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fc29243f-61da-4b53-8054-14e86a71b762 tempest-VolumesListAdminTestJSON-1340800476 None] Volume volume-33e7b954-cc27-44ee-a975-55dc0f98d58e is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:08:30.162692 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fc29243f-61da-4b53-8054-14e86a71b762 tempest-VolumesListAdminTestJSON-1340800476 None] deleting rbd volume volume-33e7b954-cc27-44ee-a975-55dc0f98d58e {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:08:30.167704 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-1711780b-6f6c-4a89-854e-0fb511238785 tempest-VolumesListAdminTestJSON-781956204 None] Acquiring lock "cinder-dd42d196-1f04-49a5-90c7-4cda3723c906-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:08:30.190875 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-1711780b-6f6c-4a89-854e-0fb511238785 tempest-VolumesListAdminTestJSON-781956204 None] Lock "cinder-dd42d196-1f04-49a5-90c7-4cda3723c906-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:08:30.237900 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=60,cinder:INSERT=5,cinder:UPDATE=31,cinder:DELETE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:08:30.313078 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1711780b-6f6c-4a89-854e-0fb511238785 tempest-VolumesListAdminTestJSON-781956204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:30.416955 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1711780b-6f6c-4a89-854e-0fb511238785 tempest-VolumesListAdminTestJSON-781956204 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:08:30.419501 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1711780b-6f6c-4a89-854e-0fb511238785 tempest-VolumesListAdminTestJSON-781956204 None] Volume volume-dd42d196-1f04-49a5-90c7-4cda3723c906 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:08:30.430079 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1711780b-6f6c-4a89-854e-0fb511238785 tempest-VolumesListAdminTestJSON-781956204 None] deleting rbd volume volume-dd42d196-1f04-49a5-90c7-4cda3723c906 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:08:30.699254 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-fc29243f-61da-4b53-8054-14e86a71b762 tempest-VolumesListAdminTestJSON-1340800476 None] Created reservations ['79ff9e7f-518c-4a41-b70f-537167989e04', '732e429a-da12-409c-880a-bf5dd880052e', '96eaf808-4f62-44d5-a488-4be2f3ad35a6', '8435e25c-b9c6-4aca-bc58-c4512201ea8d'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:08:30.806354 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fc29243f-61da-4b53-8054-14e86a71b762 tempest-VolumesListAdminTestJSON-1340800476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:30.865372 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fc29243f-61da-4b53-8054-14e86a71b762 tempest-VolumesListAdminTestJSON-1340800476 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:30.922888 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-fc29243f-61da-4b53-8054-14e86a71b762 tempest-VolumesListAdminTestJSON-1340800476 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:08:30.931778 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-fc29243f-61da-4b53-8054-14e86a71b762 tempest-VolumesListAdminTestJSON-1340800476 None] Deleted volume successfully.
Oct 29 21:08:30.953284 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-fc29243f-61da-4b53-8054-14e86a71b762 tempest-VolumesListAdminTestJSON-1340800476 None] Lock "cinder-33e7b954-cc27-44ee-a975-55dc0f98d58e-delete_volume" released by "delete_volume" :: held 1.013s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:08:30.978751 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-1711780b-6f6c-4a89-854e-0fb511238785 tempest-VolumesListAdminTestJSON-781956204 None] Created reservations ['45efa508-9a1d-4c9a-b828-ad66d9a1dd0e', 'd6ab152d-e6ef-4b48-b263-4bbb6de5b882', '5621958d-bb3c-4de3-9203-c61c3c3ca57e', 'e6586b6d-2a11-4ec1-bf76-73141f8526e8'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:08:31.061738 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1711780b-6f6c-4a89-854e-0fb511238785 tempest-VolumesListAdminTestJSON-781956204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:31.149118 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1711780b-6f6c-4a89-854e-0fb511238785 tempest-VolumesListAdminTestJSON-781956204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:31.322377 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1711780b-6f6c-4a89-854e-0fb511238785 tempest-VolumesListAdminTestJSON-781956204 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:08:31.328462 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1711780b-6f6c-4a89-854e-0fb511238785 tempest-VolumesListAdminTestJSON-781956204 None] Deleted volume successfully.
Oct 29 21:08:31.338103 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=55,cinder:UPDATE=36,cinder:INSERT=5,cinder:DELETE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:08:31.357380 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-1711780b-6f6c-4a89-854e-0fb511238785 tempest-VolumesListAdminTestJSON-781956204 None] Lock "cinder-dd42d196-1f04-49a5-90c7-4cda3723c906-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:08:31.481128 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-65b340ca-431c-4535-90d4-10d543c4a2e0 tempest-VolumesListAdminTestJSON-781956204 None] Acquiring lock "cinder-4b1a4209-1328-4a36-9f2b-5e109e498f02-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:08:31.496718 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-65b340ca-431c-4535-90d4-10d543c4a2e0 tempest-VolumesListAdminTestJSON-781956204 None] Lock "cinder-4b1a4209-1328-4a36-9f2b-5e109e498f02-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:08:31.559642 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-65b340ca-431c-4535-90d4-10d543c4a2e0 tempest-VolumesListAdminTestJSON-781956204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:31.694757 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-65b340ca-431c-4535-90d4-10d543c4a2e0 tempest-VolumesListAdminTestJSON-781956204 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:08:31.695773 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-65b340ca-431c-4535-90d4-10d543c4a2e0 tempest-VolumesListAdminTestJSON-781956204 None] Volume volume-4b1a4209-1328-4a36-9f2b-5e109e498f02 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:08:31.708500 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-65b340ca-431c-4535-90d4-10d543c4a2e0 tempest-VolumesListAdminTestJSON-781956204 None] deleting rbd volume volume-4b1a4209-1328-4a36-9f2b-5e109e498f02 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:08:32.081760 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-65b340ca-431c-4535-90d4-10d543c4a2e0 tempest-VolumesListAdminTestJSON-781956204 None] Created reservations ['adcb3ddf-d7d0-49eb-9ccb-0c7442f10770', '049a4add-15e2-4b28-8ea6-afe6be5dd97c', 'd59e337d-18a7-4185-9a96-2691ada104b9', '45b3f5b3-e12c-4f8b-a6e7-8de39de87f10'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:08:32.227227 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-65b340ca-431c-4535-90d4-10d543c4a2e0 tempest-VolumesListAdminTestJSON-781956204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:32.309507 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-65b340ca-431c-4535-90d4-10d543c4a2e0 tempest-VolumesListAdminTestJSON-781956204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:32.383436 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-65b340ca-431c-4535-90d4-10d543c4a2e0 tempest-VolumesListAdminTestJSON-781956204 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:08:32.414418 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-65b340ca-431c-4535-90d4-10d543c4a2e0 tempest-VolumesListAdminTestJSON-781956204 None] Deleted volume successfully.
Oct 29 21:08:32.445004 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-65b340ca-431c-4535-90d4-10d543c4a2e0 tempest-VolumesListAdminTestJSON-781956204 None] Lock "cinder-4b1a4209-1328-4a36-9f2b-5e109e498f02-delete_volume" released by "delete_volume" :: held 0.944s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:08:32.826292 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f9cc90b0-48ca-4516-9894-dbd9885603b1 tempest-VolumesListAdminTestJSON-781956204 None] Acquiring lock "cinder-9cf2d160-44a2-43e8-8350-8003bc894a74-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:08:32.837794 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f9cc90b0-48ca-4516-9894-dbd9885603b1 tempest-VolumesListAdminTestJSON-781956204 None] Lock "cinder-9cf2d160-44a2-43e8-8350-8003bc894a74-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:08:32.958133 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f9cc90b0-48ca-4516-9894-dbd9885603b1 tempest-VolumesListAdminTestJSON-781956204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:33.128971 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f9cc90b0-48ca-4516-9894-dbd9885603b1 tempest-VolumesListAdminTestJSON-781956204 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:08:33.129654 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f9cc90b0-48ca-4516-9894-dbd9885603b1 tempest-VolumesListAdminTestJSON-781956204 None] Volume volume-9cf2d160-44a2-43e8-8350-8003bc894a74 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:08:33.146724 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f9cc90b0-48ca-4516-9894-dbd9885603b1 tempest-VolumesListAdminTestJSON-781956204 None] deleting rbd volume volume-9cf2d160-44a2-43e8-8350-8003bc894a74 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:08:33.640183 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-f9cc90b0-48ca-4516-9894-dbd9885603b1 tempest-VolumesListAdminTestJSON-781956204 None] Created reservations ['635d87cb-49a3-408c-8944-0f7332bd105d', '764bb166-4860-40e6-a928-aa8fce747243', '5922b86b-f7c8-40ea-a3c3-68f4db42e778', 'f3607a45-fae5-412c-b044-1fae0ad20afc'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:08:33.765814 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f9cc90b0-48ca-4516-9894-dbd9885603b1 tempest-VolumesListAdminTestJSON-781956204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:33.814262 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f9cc90b0-48ca-4516-9894-dbd9885603b1 tempest-VolumesListAdminTestJSON-781956204 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:33.878373 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-f9cc90b0-48ca-4516-9894-dbd9885603b1 tempest-VolumesListAdminTestJSON-781956204 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:08:33.893126 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f9cc90b0-48ca-4516-9894-dbd9885603b1 tempest-VolumesListAdminTestJSON-781956204 None] Deleted volume successfully.
Oct 29 21:08:33.917502 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f9cc90b0-48ca-4516-9894-dbd9885603b1 tempest-VolumesListAdminTestJSON-781956204 None] Lock "cinder-9cf2d160-44a2-43e8-8350-8003bc894a74-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:08:43.693214 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:08:43.789860 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Flow 'volume_create_manager' (53d968b1-7103-435b-a72f-baa340cbb3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:08:43.816031 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439d34e1-65fd-43d9-9a49-1999b6090b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:43.876386 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (439d34e1-65fd-43d9-9a49-1999b6090b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1794058781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=82996c3e-0ebf-42bd-9cb5-6ee1e1f11d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e2b2e1d93594f51a3b1fdea9c507ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:08:44Z,use_quota=True,user_id='20b837a9845d4e9eb1abcb3b415081e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:43.886340 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc6fc70-0b60-4c57-ac71-9c666591595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:43.895670 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc6fc70-0b60-4c57-ac71-9c666591595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:43.910900 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95428e93-77b5-4728-a7de-58af279867ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:43.925193 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95428e93-77b5-4728-a7de-58af279867ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82996c3e-0ebf-42bd-9cb5-6ee1e1f11d86', 'volume_name': 'volume-82996c3e-0ebf-42bd-9cb5-6ee1e1f11d86', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:43.936273 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2d777c-2b91-425f-8488-9e6cc0c51353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:43.959031 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2d777c-2b91-425f-8488-9e6cc0c51353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:43.968033 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1de4367-671f-4153-a0df-3868d9a11bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:43.973434 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Volume 82996c3e-0ebf-42bd-9cb5-6ee1e1f11d86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82996c3e-0ebf-42bd-9cb5-6ee1e1f11d86', 'volume_size': 1}
Oct 29 21:08:43.982003 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] creating volume 'volume-82996c3e-0ebf-42bd-9cb5-6ee1e1f11d86' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:08:43.984813 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:44.160958 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:08:44.161585 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:08:44.165604 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1de4367-671f-4153-a0df-3868d9a11bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82996c3e-0ebf-42bd-9cb5-6ee1e1f11d86', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:44.173264 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84af5a55-fd35-427e-aee3-d226b56968d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:44.206263 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Volume volume-82996c3e-0ebf-42bd-9cb5-6ee1e1f11d86 (82996c3e-0ebf-42bd-9cb5-6ee1e1f11d86): created successfully
Oct 29 21:08:44.210461 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84af5a55-fd35-427e-aee3-d226b56968d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:44.253381 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Flow 'volume_create_manager' (53d968b1-7103-435b-a72f-baa340cbb3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:08:44.281523 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-6aa341aa-ee56-4fb3-92b7-be50a5e41f98 tempest-AbsoluteLimitsTests-420172489 None] Created volume successfully.
Oct 29 21:08:44.301331 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=50,cinder:INSERT=9,cinder:UPDATE=38,cinder:DELETE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:08:45.148603 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a971fe3b-660e-45d4-a52c-8862aeb7dcfe tempest-AbsoluteLimitsTests-420172489 None] Acquiring lock "cinder-82996c3e-0ebf-42bd-9cb5-6ee1e1f11d86-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:08:45.176777 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a971fe3b-660e-45d4-a52c-8862aeb7dcfe tempest-AbsoluteLimitsTests-420172489 None] Lock "cinder-82996c3e-0ebf-42bd-9cb5-6ee1e1f11d86-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:08:45.264488 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a971fe3b-660e-45d4-a52c-8862aeb7dcfe tempest-AbsoluteLimitsTests-420172489 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:45.343042 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a971fe3b-660e-45d4-a52c-8862aeb7dcfe tempest-AbsoluteLimitsTests-420172489 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:08:45.343759 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a971fe3b-660e-45d4-a52c-8862aeb7dcfe tempest-AbsoluteLimitsTests-420172489 None] Volume volume-82996c3e-0ebf-42bd-9cb5-6ee1e1f11d86 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:08:45.353717 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a971fe3b-660e-45d4-a52c-8862aeb7dcfe tempest-AbsoluteLimitsTests-420172489 None] deleting rbd volume volume-82996c3e-0ebf-42bd-9cb5-6ee1e1f11d86 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:08:45.781777 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-a971fe3b-660e-45d4-a52c-8862aeb7dcfe tempest-AbsoluteLimitsTests-420172489 None] Created reservations ['e3dbdaca-d424-4895-a741-872f15bd20ea', '61a7d728-0ae2-4fd7-aa22-0024d1e5cc5d', '25518ded-8bc7-4aaf-801f-04513c23eea9', '339f37da-c23f-42c9-8fca-fc1ef77c4662'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:08:45.941386 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a971fe3b-660e-45d4-a52c-8862aeb7dcfe tempest-AbsoluteLimitsTests-420172489 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:46.054579 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a971fe3b-660e-45d4-a52c-8862aeb7dcfe tempest-AbsoluteLimitsTests-420172489 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:46.141960 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-a971fe3b-660e-45d4-a52c-8862aeb7dcfe tempest-AbsoluteLimitsTests-420172489 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:08:46.147561 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a971fe3b-660e-45d4-a52c-8862aeb7dcfe tempest-AbsoluteLimitsTests-420172489 None] Deleted volume successfully.
Oct 29 21:08:46.182564 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a971fe3b-660e-45d4-a52c-8862aeb7dcfe tempest-AbsoluteLimitsTests-420172489 None] Lock "cinder-82996c3e-0ebf-42bd-9cb5-6ee1e1f11d86-delete_volume" released by "delete_volume" :: held 1.006s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:08:56.193033 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:08:56.222072 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Flow 'volume_create_manager' (975cd43d-f116-47d4-94e7-971c7fad12c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:08:56.231991 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8dccf94-2cf8-4a5a-bc61-8fe8a5c4fb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:56.264140 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8dccf94-2cf8-4a5a-bc61-8fe8a5c4fb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1094754395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e3436be7-34a2-4551-b867-e50a1d7ee36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b72e2e50ac14e9ebe4aa84936c33631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:08:56Z,use_quota=True,user_id='0a4fe489b7a74dc3b436a2eb9f3bcc4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:56.273474 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54ddd2b-7dae-419f-bd8f-777c91e17c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:56.285207 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54ddd2b-7dae-419f-bd8f-777c91e17c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:56.294199 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17341656-ecaa-4268-b674-95ed885b53b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:56.299497 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17341656-ecaa-4268-b674-95ed885b53b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3436be7-34a2-4551-b867-e50a1d7ee36a', 'volume_name': 'volume-e3436be7-34a2-4551-b867-e50a1d7ee36a', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:56.311339 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31508754-bea5-4cda-a960-8cdcf47d7b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:56.322862 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31508754-bea5-4cda-a960-8cdcf47d7b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:56.336683 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560e6d16-9295-48c7-81cb-49c00b83b786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:56.338207 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Volume e3436be7-34a2-4551-b867-e50a1d7ee36a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3436be7-34a2-4551-b867-e50a1d7ee36a', 'volume_size': 1}
Oct 29 21:08:56.338604 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] creating volume 'volume-e3436be7-34a2-4551-b867-e50a1d7ee36a' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:08:56.343153 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:56.508009 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:08:56.508546 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:08:56.512502 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (560e6d16-9295-48c7-81cb-49c00b83b786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3436be7-34a2-4551-b867-e50a1d7ee36a', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:56.529104 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4586bd87-4ca9-4e91-991d-d806a76b3f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:08:56.554219 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Volume volume-e3436be7-34a2-4551-b867-e50a1d7ee36a (e3436be7-34a2-4551-b867-e50a1d7ee36a): created successfully
Oct 29 21:08:56.558014 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4586bd87-4ca9-4e91-991d-d806a76b3f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:08:56.579870 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Flow 'volume_create_manager' (975cd43d-f116-47d4-94e7-971c7fad12c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:08:56.614811 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-41503146-4ff2-4f42-add8-ec547dd9ffa3 tempest-VolumesTransfersTest-461768991 None] Created volume successfully.
Oct 29 21:08:58.190291 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7db9df0e-2a7b-481d-936c-afdb705bafa2 tempest-VolumesTransfersTest-1042235503 None] Transfer volume completed successfully.
Oct 29 21:08:59.547527 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e566e8db-8fd7-4378-9821-bdb5aacb535d tempest-VolumesTransfersTest-978182159 None] Acquiring lock "cinder-e3436be7-34a2-4551-b867-e50a1d7ee36a-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:08:59.580108 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e566e8db-8fd7-4378-9821-bdb5aacb535d tempest-VolumesTransfersTest-978182159 None] Lock "cinder-e3436be7-34a2-4551-b867-e50a1d7ee36a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:08:59.671927 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e566e8db-8fd7-4378-9821-bdb5aacb535d tempest-VolumesTransfersTest-978182159 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:08:59.780626 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e566e8db-8fd7-4378-9821-bdb5aacb535d tempest-VolumesTransfersTest-978182159 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:08:59.782151 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e566e8db-8fd7-4378-9821-bdb5aacb535d tempest-VolumesTransfersTest-978182159 None] Volume volume-e3436be7-34a2-4551-b867-e50a1d7ee36a is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:08:59.795848 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e566e8db-8fd7-4378-9821-bdb5aacb535d tempest-VolumesTransfersTest-978182159 None] deleting rbd volume volume-e3436be7-34a2-4551-b867-e50a1d7ee36a {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:09:00.140607 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-e566e8db-8fd7-4378-9821-bdb5aacb535d tempest-VolumesTransfersTest-978182159 None] Created reservations ['4656943d-d1ab-431c-8532-9e1df0a78f6b', 'e56ab45f-7332-447e-8616-3934388f5798', '2b309dd9-18ba-4e9c-b9a2-e1ed8755bcad', '70999353-7a2c-4bd8-9650-524e57cb1980'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:09:00.213477 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=58,cinder:INSERT=8,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:09:00.223004 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e566e8db-8fd7-4378-9821-bdb5aacb535d tempest-VolumesTransfersTest-978182159 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:00.330256 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e566e8db-8fd7-4378-9821-bdb5aacb535d tempest-VolumesTransfersTest-978182159 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:00.393787 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-e566e8db-8fd7-4378-9821-bdb5aacb535d tempest-VolumesTransfersTest-978182159 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:09:00.403472 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-e566e8db-8fd7-4378-9821-bdb5aacb535d tempest-VolumesTransfersTest-978182159 None] Deleted volume successfully.
Oct 29 21:09:00.424006 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e566e8db-8fd7-4378-9821-bdb5aacb535d tempest-VolumesTransfersTest-978182159 None] Lock "cinder-e3436be7-34a2-4551-b867-e50a1d7ee36a-delete_volume" released by "delete_volume" :: held 0.844s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:09:01.386405 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:09:01.387044 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:01.448689 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:01.528142 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:09:01.541449 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:09:01.589183 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Flow 'volume_create_manager' (d06087a5-2828-4f1d-bc02-273972faba7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:09:01.598123 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1dbf82-02d7-4f3c-9a21-62c0675e9c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:01.622601 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1dbf82-02d7-4f3c-9a21-62c0675e9c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1322035700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2b9ca914-7848-4f2a-ba66-cdc57a2f0373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b72e2e50ac14e9ebe4aa84936c33631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:09:01Z,use_quota=True,user_id='0a4fe489b7a74dc3b436a2eb9f3bcc4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:01.628665 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084f3b66-6e17-409c-8dea-9e8e29d1a9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:01.634167 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084f3b66-6e17-409c-8dea-9e8e29d1a9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:01.640292 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c515aaf-1923-48f4-b0f0-15d3feb23c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:01.648757 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c515aaf-1923-48f4-b0f0-15d3feb23c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b9ca914-7848-4f2a-ba66-cdc57a2f0373', 'volume_name': 'volume-2b9ca914-7848-4f2a-ba66-cdc57a2f0373', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:01.660514 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c9b4b8-4156-41fd-ad71-ccb2a03b685b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:01.665791 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c9b4b8-4156-41fd-ad71-ccb2a03b685b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:01.694465 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc83f1cb-7240-416e-873c-5728f4389fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:01.700957 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Volume 2b9ca914-7848-4f2a-ba66-cdc57a2f0373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b9ca914-7848-4f2a-ba66-cdc57a2f0373', 'volume_size': 1}
Oct 29 21:09:01.701365 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] creating volume 'volume-2b9ca914-7848-4f2a-ba66-cdc57a2f0373' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:09:01.703942 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:01.803078 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:09:01.803807 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:09:01.809023 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc83f1cb-7240-416e-873c-5728f4389fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b9ca914-7848-4f2a-ba66-cdc57a2f0373', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:01.815755 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0ee49d-4c2f-4d59-91c7-bb3bc7f7eace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:01.838434 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Volume volume-2b9ca914-7848-4f2a-ba66-cdc57a2f0373 (2b9ca914-7848-4f2a-ba66-cdc57a2f0373): created successfully
Oct 29 21:09:01.842748 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0ee49d-4c2f-4d59-91c7-bb3bc7f7eace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:01.850118 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Flow 'volume_create_manager' (d06087a5-2828-4f1d-bc02-273972faba7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:09:01.862715 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-71f37d61-060a-44f9-ba47-6e622bc949d1 tempest-VolumesTransfersTest-461768991 None] Created volume successfully.
Oct 29 21:09:02.931277 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a3c1b2e7-7fe3-43e3-bdcf-6a6bad527092 tempest-VolumesTransfersTest-978182159 None] Acquiring lock "cinder-2b9ca914-7848-4f2a-ba66-cdc57a2f0373-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:09:02.943850 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a3c1b2e7-7fe3-43e3-bdcf-6a6bad527092 tempest-VolumesTransfersTest-978182159 None] Lock "cinder-2b9ca914-7848-4f2a-ba66-cdc57a2f0373-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:09:03.030505 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a3c1b2e7-7fe3-43e3-bdcf-6a6bad527092 tempest-VolumesTransfersTest-978182159 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:03.129093 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a3c1b2e7-7fe3-43e3-bdcf-6a6bad527092 tempest-VolumesTransfersTest-978182159 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:09:03.130074 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a3c1b2e7-7fe3-43e3-bdcf-6a6bad527092 tempest-VolumesTransfersTest-978182159 None] Volume volume-2b9ca914-7848-4f2a-ba66-cdc57a2f0373 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:09:03.138070 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a3c1b2e7-7fe3-43e3-bdcf-6a6bad527092 tempest-VolumesTransfersTest-978182159 None] deleting rbd volume volume-2b9ca914-7848-4f2a-ba66-cdc57a2f0373 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:09:03.485535 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-a3c1b2e7-7fe3-43e3-bdcf-6a6bad527092 tempest-VolumesTransfersTest-978182159 None] Created reservations ['3fcc1505-b994-4293-bbb5-0d81179febd5', '110e93a8-3140-4616-9634-e02a336a7268', '727ca893-bc00-4305-99e8-9aef1869ff72', '2f0c7355-0ee2-4663-97cc-f4f8b93a1286'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:09:03.545741 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a3c1b2e7-7fe3-43e3-bdcf-6a6bad527092 tempest-VolumesTransfersTest-978182159 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:03.609369 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a3c1b2e7-7fe3-43e3-bdcf-6a6bad527092 tempest-VolumesTransfersTest-978182159 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:03.666778 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-a3c1b2e7-7fe3-43e3-bdcf-6a6bad527092 tempest-VolumesTransfersTest-978182159 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:09:03.674119 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a3c1b2e7-7fe3-43e3-bdcf-6a6bad527092 tempest-VolumesTransfersTest-978182159 None] Deleted volume successfully.
Oct 29 21:09:03.689186 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a3c1b2e7-7fe3-43e3-bdcf-6a6bad527092 tempest-VolumesTransfersTest-978182159 None] Lock "cinder-2b9ca914-7848-4f2a-ba66-cdc57a2f0373-delete_volume" released by "delete_volume" :: held 0.745s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:09:09.697128 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:09:09.729321 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Flow 'volume_create_manager' (7c925bdf-7e68-47e5-945a-9bae71f1ce76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:09:09.740377 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29998ab3-d39a-4f09-9b58-5c081af03a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:09.766073 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29998ab3-d39a-4f09-9b58-5c081af03a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1668178545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6c628cbb-6e0f-4a1a-b009-e6e96b37461f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12180c0f6b864b1fb51205b953d21b33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:09:10Z,use_quota=True,user_id='f017a1dc8dac4441940528d0e939f05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:09.776841 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4114bab-4692-47da-9afe-35a323163c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:09.785130 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4114bab-4692-47da-9afe-35a323163c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:09.790137 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69acee7f-ad94-477e-a720-5b7a82728e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:09.794875 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69acee7f-ad94-477e-a720-5b7a82728e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c628cbb-6e0f-4a1a-b009-e6e96b37461f', 'volume_name': 'volume-6c628cbb-6e0f-4a1a-b009-e6e96b37461f', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:09.800875 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2e60c3-c153-463e-a10e-49bd23d0bb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:09.805408 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2e60c3-c153-463e-a10e-49bd23d0bb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:09.811091 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4161ae63-3cc8-489e-a6b9-b30ef1ab0951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:09.812591 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Volume 6c628cbb-6e0f-4a1a-b009-e6e96b37461f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c628cbb-6e0f-4a1a-b009-e6e96b37461f', 'volume_size': 1}
Oct 29 21:09:09.813175 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] creating volume 'volume-6c628cbb-6e0f-4a1a-b009-e6e96b37461f' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:09:09.814776 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:09.916657 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:09:09.917052 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:09:09.920759 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4161ae63-3cc8-489e-a6b9-b30ef1ab0951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c628cbb-6e0f-4a1a-b009-e6e96b37461f', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:09.929782 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5434e7e5-dd54-4411-89d2-231e813b571f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:09.944626 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Volume volume-6c628cbb-6e0f-4a1a-b009-e6e96b37461f (6c628cbb-6e0f-4a1a-b009-e6e96b37461f): created successfully
Oct 29 21:09:09.952309 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5434e7e5-dd54-4411-89d2-231e813b571f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:09.963787 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Flow 'volume_create_manager' (7c925bdf-7e68-47e5-945a-9bae71f1ce76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:09:09.981057 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-d6e62582-f74e-47c4-8c5d-0d24fdf37868 tempest-VolumesNegativeTest-231078002 None] Created volume successfully.
Oct 29 21:09:22.605828 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=50,cinder:INSERT=5,cinder:UPDATE=28,cinder:DELETE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:09:32.604450 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=25,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:09:45.466615 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-38ec4577-5d96-4db7-96d1-d8a30d8ccd66 tempest-VolumesNegativeTest-231078002 None] Acquiring lock "cinder-6c628cbb-6e0f-4a1a-b009-e6e96b37461f-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:09:45.487418 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-38ec4577-5d96-4db7-96d1-d8a30d8ccd66 tempest-VolumesNegativeTest-231078002 None] Lock "cinder-6c628cbb-6e0f-4a1a-b009-e6e96b37461f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:09:45.598086 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-38ec4577-5d96-4db7-96d1-d8a30d8ccd66 tempest-VolumesNegativeTest-231078002 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:45.696356 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-38ec4577-5d96-4db7-96d1-d8a30d8ccd66 tempest-VolumesNegativeTest-231078002 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:09:45.696796 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-38ec4577-5d96-4db7-96d1-d8a30d8ccd66 tempest-VolumesNegativeTest-231078002 None] Volume volume-6c628cbb-6e0f-4a1a-b009-e6e96b37461f is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:09:45.703766 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-38ec4577-5d96-4db7-96d1-d8a30d8ccd66 tempest-VolumesNegativeTest-231078002 None] deleting rbd volume volume-6c628cbb-6e0f-4a1a-b009-e6e96b37461f {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:09:46.104261 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-38ec4577-5d96-4db7-96d1-d8a30d8ccd66 tempest-VolumesNegativeTest-231078002 None] Created reservations ['cca29196-a559-4c06-a6f4-80a7166c6f01', 'f17bc2b1-69b0-4c0b-978d-0dc5f40e4a4d', 'd9212d11-c657-43ca-9c4d-4757dcda797e', '739b1e05-f231-4bed-8a86-fee2aece3f1b'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:09:46.212590 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-38ec4577-5d96-4db7-96d1-d8a30d8ccd66 tempest-VolumesNegativeTest-231078002 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:46.285177 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-38ec4577-5d96-4db7-96d1-d8a30d8ccd66 tempest-VolumesNegativeTest-231078002 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:46.369267 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-38ec4577-5d96-4db7-96d1-d8a30d8ccd66 tempest-VolumesNegativeTest-231078002 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:09:46.380907 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-38ec4577-5d96-4db7-96d1-d8a30d8ccd66 tempest-VolumesNegativeTest-231078002 None] Deleted volume successfully.
Oct 29 21:09:46.419610 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-38ec4577-5d96-4db7-96d1-d8a30d8ccd66 tempest-VolumesNegativeTest-231078002 None] Lock "cinder-6c628cbb-6e0f-4a1a-b009-e6e96b37461f-delete_volume" released by "delete_volume" :: held 0.932s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:09:51.510004 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:09:51.552980 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Flow 'volume_create_manager' (cad5708d-b6bf-4766-ab1e-d33c4d1b0852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:09:51.583395 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb101e3-66f1-49bf-a52f-a92cdf81b095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:51.631545 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb101e3-66f1-49bf-a52f-a92cdf81b095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1256718737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b9e4fb7b-2586-4f13-a340-b02cbf750ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52b5b66897c643b88b0ee0b3db09ec11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:09:51Z,use_quota=True,user_id='ebb4456cb1394b1daa3486517b13e23f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:51.648513 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e573474f-122e-43a1-b282-de59b947eaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:51.660293 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e573474f-122e-43a1-b282-de59b947eaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:51.674590 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8d1a0e-4645-447f-a770-4e971ae991a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:51.681175 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8d1a0e-4645-447f-a770-4e971ae991a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e4fb7b-2586-4f13-a340-b02cbf750ebb', 'volume_name': 'volume-b9e4fb7b-2586-4f13-a340-b02cbf750ebb', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:51.688011 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44c800e-be7a-497c-91e6-3c36a692b2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:51.694165 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44c800e-be7a-497c-91e6-3c36a692b2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:51.714614 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d28775-1a63-4cc8-b446-7382a7eee9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:51.716379 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Volume b9e4fb7b-2586-4f13-a340-b02cbf750ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e4fb7b-2586-4f13-a340-b02cbf750ebb', 'volume_size': 1}
Oct 29 21:09:51.717136 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] creating volume 'volume-b9e4fb7b-2586-4f13-a340-b02cbf750ebb' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:09:51.718234 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:51.864289 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:09:51.864991 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:09:51.870018 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d28775-1a63-4cc8-b446-7382a7eee9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e4fb7b-2586-4f13-a340-b02cbf750ebb', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:51.878794 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7443fda3-b093-43f9-a963-7b7b3a4d7557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:09:51.899977 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Volume volume-b9e4fb7b-2586-4f13-a340-b02cbf750ebb (b9e4fb7b-2586-4f13-a340-b02cbf750ebb): created successfully
Oct 29 21:09:51.906932 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7443fda3-b093-43f9-a963-7b7b3a4d7557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:09:51.914682 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Flow 'volume_create_manager' (cad5708d-b6bf-4766-ab1e-d33c4d1b0852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:09:51.937036 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7d6ec725-6f94-4323-8222-a7a11dfe9a71 tempest-VolumesSnapshotListTestJSON-1128370958 None] Created volume successfully.
Oct 29 21:09:52.888358 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=21,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:09:52.947754 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8dab014b-c344-4c1b-ab29-85e1ff1a87c5 tempest-VolumesSnapshotListTestJSON-1128370958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:53.721732 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-8dab014b-c344-4c1b-ab29-85e1ff1a87c5 tempest-VolumesSnapshotListTestJSON-1128370958 None] Create snapshot completed successfully
Oct 29 21:09:54.465277 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-529d270a-09f5-4a92-ac9b-fa46b33da47e tempest-VolumesSnapshotListTestJSON-1128370958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:55.685159 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-529d270a-09f5-4a92-ac9b-fa46b33da47e tempest-VolumesSnapshotListTestJSON-1128370958 None] Create snapshot completed successfully
Oct 29 21:09:56.882900 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6c451faa-ce14-419a-9824-83152bf90eab tempest-VolumesSnapshotListTestJSON-1128370958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:57.723120 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-6c451faa-ce14-419a-9824-83152bf90eab tempest-VolumesSnapshotListTestJSON-1128370958 None] Create snapshot completed successfully
Oct 29 21:09:59.183110 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-20239947-37d0-450c-b92a-42cad6c685b5 tempest-VolumesSnapshotListTestJSON-1128370958 None] Acquiring lock "cinder-d9f508e3-a863-46c6-b6f7-2877f24e0e3d-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:09:59.197321 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-20239947-37d0-450c-b92a-42cad6c685b5 tempest-VolumesSnapshotListTestJSON-1128370958 None] Lock "cinder-d9f508e3-a863-46c6-b6f7-2877f24e0e3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:09:59.199115 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-20239947-37d0-450c-b92a-42cad6c685b5 tempest-VolumesSnapshotListTestJSON-1128370958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:09:59.771942 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-20239947-37d0-450c-b92a-42cad6c685b5 tempest-VolumesSnapshotListTestJSON-1128370958 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:09:59.794325 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-20239947-37d0-450c-b92a-42cad6c685b5 tempest-VolumesSnapshotListTestJSON-1128370958 None] Created reservations ['2f17ed7c-3c35-4c50-8f26-ba50d2c8dabd', 'ba9c9946-01cc-47fe-b4a6-b58ba0617c21', 'bcf2dd90-81cf-4ee9-ae54-b97842313745', 'b7dca662-fed3-4d15-8953-c85f3b27172b'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:09:59.897467 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-20239947-37d0-450c-b92a-42cad6c685b5 tempest-VolumesSnapshotListTestJSON-1128370958 None] Delete snapshot completed successfully.
Oct 29 21:09:59.912529 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-20239947-37d0-450c-b92a-42cad6c685b5 tempest-VolumesSnapshotListTestJSON-1128370958 None] Lock "cinder-d9f508e3-a863-46c6-b6f7-2877f24e0e3d-delete_snapshot" released by "delete_snapshot" :: held 0.714s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:10:00.401755 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f38d4c59-9564-40f8-8bd2-81d77df82144 tempest-VolumesSnapshotListTestJSON-1128370958 None] Acquiring lock "cinder-e015a7bf-0853-4729-a633-962027807bab-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:10:00.434795 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f38d4c59-9564-40f8-8bd2-81d77df82144 tempest-VolumesSnapshotListTestJSON-1128370958 None] Lock "cinder-e015a7bf-0853-4729-a633-962027807bab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:10:00.443015 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f38d4c59-9564-40f8-8bd2-81d77df82144 tempest-VolumesSnapshotListTestJSON-1128370958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:10:01.386939 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:10:01.390006 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:10:01.443605 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:10:01.491268 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:10:01.606551 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-f38d4c59-9564-40f8-8bd2-81d77df82144 tempest-VolumesSnapshotListTestJSON-1128370958 None] Created reservations ['35b3d227-a322-4e8b-8aab-79fb96237ecf', '2d7e49cd-867a-4a41-a5d4-29a5e7b13991', '665bf14b-069d-4c22-abb5-17d8fbc3f771', 'f1d1a867-b329-4132-aed2-5206c94c2732'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:10:01.674373 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f38d4c59-9564-40f8-8bd2-81d77df82144 tempest-VolumesSnapshotListTestJSON-1128370958 None] Delete snapshot completed successfully.
Oct 29 21:10:01.681075 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f38d4c59-9564-40f8-8bd2-81d77df82144 tempest-VolumesSnapshotListTestJSON-1128370958 None] Lock "cinder-e015a7bf-0853-4729-a633-962027807bab-delete_snapshot" released by "delete_snapshot" :: held 1.247s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:10:02.638803 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-7570dedb-3875-478e-bb57-c5bc5f8a2802 tempest-VolumesSnapshotListTestJSON-1128370958 None] Acquiring lock "cinder-e0427a74-024b-422a-b536-2c8c8787390a-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:10:02.672948 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-7570dedb-3875-478e-bb57-c5bc5f8a2802 tempest-VolumesSnapshotListTestJSON-1128370958 None] Lock "cinder-e0427a74-024b-422a-b536-2c8c8787390a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:10:02.680610 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7570dedb-3875-478e-bb57-c5bc5f8a2802 tempest-VolumesSnapshotListTestJSON-1128370958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:10:03.542026 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=55,cinder:UPDATE=29,cinder:INSERT=5,cinder:DELETE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:10:03.599347 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-7570dedb-3875-478e-bb57-c5bc5f8a2802 tempest-VolumesSnapshotListTestJSON-1128370958 None] Created reservations ['27a204fc-e40d-4374-8628-5d9dd79ae574', '0f7eff42-f54d-457a-a843-70c32ead8f10', 'be79f661-0539-4455-83f6-80cb9c6b2ce2', 'e4356906-5a92-436d-bb95-86d67524de5e'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:10:03.669160 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7570dedb-3875-478e-bb57-c5bc5f8a2802 tempest-VolumesSnapshotListTestJSON-1128370958 None] Delete snapshot completed successfully.
Oct 29 21:10:03.682058 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-7570dedb-3875-478e-bb57-c5bc5f8a2802 tempest-VolumesSnapshotListTestJSON-1128370958 None] Lock "cinder-e0427a74-024b-422a-b536-2c8c8787390a-delete_snapshot" released by "delete_snapshot" :: held 1.013s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:10:03.885896 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-85d2c535-ecc8-4525-9094-19adb956d3b6 tempest-VolumesSnapshotListTestJSON-1128370958 None] Acquiring lock "cinder-b9e4fb7b-2586-4f13-a340-b02cbf750ebb-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:10:03.903350 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-85d2c535-ecc8-4525-9094-19adb956d3b6 tempest-VolumesSnapshotListTestJSON-1128370958 None] Lock "cinder-b9e4fb7b-2586-4f13-a340-b02cbf750ebb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:10:04.068366 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-85d2c535-ecc8-4525-9094-19adb956d3b6 tempest-VolumesSnapshotListTestJSON-1128370958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:10:04.204743 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-85d2c535-ecc8-4525-9094-19adb956d3b6 tempest-VolumesSnapshotListTestJSON-1128370958 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:10:04.205250 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-85d2c535-ecc8-4525-9094-19adb956d3b6 tempest-VolumesSnapshotListTestJSON-1128370958 None] Volume volume-b9e4fb7b-2586-4f13-a340-b02cbf750ebb is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:10:04.223289 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-85d2c535-ecc8-4525-9094-19adb956d3b6 tempest-VolumesSnapshotListTestJSON-1128370958 None] deleting rbd volume volume-b9e4fb7b-2586-4f13-a340-b02cbf750ebb {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:10:04.600680 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-85d2c535-ecc8-4525-9094-19adb956d3b6 tempest-VolumesSnapshotListTestJSON-1128370958 None] Created reservations ['37051e11-70b5-4f77-be3d-25fe66a2122e', '2accf220-45e1-45cd-94b3-f88e6234a424', 'e6afce27-837b-4d99-b821-d8479404d51c', '290ae8ad-39b0-40b4-982e-859ab51369c4'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:10:04.689901 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-85d2c535-ecc8-4525-9094-19adb956d3b6 tempest-VolumesSnapshotListTestJSON-1128370958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:10:04.751074 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-85d2c535-ecc8-4525-9094-19adb956d3b6 tempest-VolumesSnapshotListTestJSON-1128370958 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:10:04.831544 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-85d2c535-ecc8-4525-9094-19adb956d3b6 tempest-VolumesSnapshotListTestJSON-1128370958 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:10:04.838138 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-85d2c535-ecc8-4525-9094-19adb956d3b6 tempest-VolumesSnapshotListTestJSON-1128370958 None] Deleted volume successfully.
Oct 29 21:10:04.860389 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-85d2c535-ecc8-4525-9094-19adb956d3b6 tempest-VolumesSnapshotListTestJSON-1128370958 None] Lock "cinder-b9e4fb7b-2586-4f13-a340-b02cbf750ebb-delete_volume" released by "delete_volume" :: held 0.957s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:10:22.607917 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:INSERT=3,cinder:SELECT=21,cinder:UPDATE=12 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:10:28.841377 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=58,cinder:DELETE=2,cinder:UPDATE=28,cinder:INSERT=9 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:10:28.914339 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:10:28.948276 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Flow 'volume_create_manager' (a7d35a1a-b0a6-44a9-be9d-964216d2b98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:10:28.958243 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f470a8-91dd-4e62-ac34-152bba4ee317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:28.986874 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f470a8-91dd-4e62-ac34-152bba4ee317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-29844744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c70004a7-678b-41f5-81b6-131c2e4d9d74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='208de26bb7304ee793bac715fb73fbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:10:29Z,use_quota=True,user_id='04d3c643e9c245eeaa6328d22184bc00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:29.015320 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330c80da-7755-4460-8bf2-77de0f071c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:29.026118 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330c80da-7755-4460-8bf2-77de0f071c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:29.047407 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f498ae65-dbe8-415a-ad06-09e1f70ef851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:29.067643 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f498ae65-dbe8-415a-ad06-09e1f70ef851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c70004a7-678b-41f5-81b6-131c2e4d9d74', 'volume_name': 'volume-c70004a7-678b-41f5-81b6-131c2e4d9d74', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:29.081408 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38275ee-5064-470d-be24-677f10b7270d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:29.086196 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38275ee-5064-470d-be24-677f10b7270d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:29.096988 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9137a6-aa9f-46ad-9bf8-fda4f664041a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:29.098461 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Volume c70004a7-678b-41f5-81b6-131c2e4d9d74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c70004a7-678b-41f5-81b6-131c2e4d9d74', 'volume_size': 1}
Oct 29 21:10:29.099178 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] creating volume 'volume-c70004a7-678b-41f5-81b6-131c2e4d9d74' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:10:29.100476 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:10:29.226231 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:10:29.226613 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:10:29.231520 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9137a6-aa9f-46ad-9bf8-fda4f664041a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70004a7-678b-41f5-81b6-131c2e4d9d74', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:29.245692 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead859f8-e380-4e97-a18f-2e021788a5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:29.271978 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Volume volume-c70004a7-678b-41f5-81b6-131c2e4d9d74 (c70004a7-678b-41f5-81b6-131c2e4d9d74): created successfully
Oct 29 21:10:29.274037 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead859f8-e380-4e97-a18f-2e021788a5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:29.279339 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Flow 'volume_create_manager' (a7d35a1a-b0a6-44a9-be9d-964216d2b98a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:10:29.312681 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-d3588b34-e96f-42ae-9a80-f99a902cca49 tempest-AttachVolumeTestJSON-984626347 None] Created volume successfully.
Oct 29 21:10:30.553120 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:10:30.610055 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Flow 'volume_create_manager' (ac95dc13-0fbc-4f03-a6da-47ec39c0dc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:10:30.636660 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb9f522-e99e-499f-a0d4-f533474ec915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:30.686429 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb9f522-e99e-499f-a0d4-f533474ec915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1629362423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e7628d78-193e-456e-ab22-7607b628008d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad443ad0828409d8aada4cf90bfc696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:10:30Z,use_quota=True,user_id='2c6db5dbdaf2447d8c158f1a8076b290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:30.703098 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a938446-55f2-4df7-bc11-8c40e695edc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:30.716376 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a938446-55f2-4df7-bc11-8c40e695edc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:30.736104 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcdf39bd-61bf-4370-acd3-0145958a2627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:30.744025 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcdf39bd-61bf-4370-acd3-0145958a2627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7628d78-193e-456e-ab22-7607b628008d', 'volume_name': 'volume-e7628d78-193e-456e-ab22-7607b628008d', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:30.756966 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e96dfd2-bde4-41c6-a331-04aafcdea8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:30.763778 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e96dfd2-bde4-41c6-a331-04aafcdea8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:30.793822 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5da6d15-864a-4ed4-9a2c-b4a39bd3c301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:30.794958 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Volume e7628d78-193e-456e-ab22-7607b628008d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7628d78-193e-456e-ab22-7607b628008d', 'volume_size': 1}
Oct 29 21:10:30.795362 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] creating volume 'volume-e7628d78-193e-456e-ab22-7607b628008d' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:10:30.796072 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:10:30.938312 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:10:30.938783 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:10:30.944562 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5da6d15-864a-4ed4-9a2c-b4a39bd3c301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7628d78-193e-456e-ab22-7607b628008d', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:30.974803 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293eceb5-54b9-4203-a377-ed47c2a9a15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:31.011502 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Volume volume-e7628d78-193e-456e-ab22-7607b628008d (e7628d78-193e-456e-ab22-7607b628008d): created successfully
Oct 29 21:10:31.016527 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293eceb5-54b9-4203-a377-ed47c2a9a15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:31.024709 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Flow 'volume_create_manager' (ac95dc13-0fbc-4f03-a6da-47ec39c0dc1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:10:31.052696 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-12b968cd-3572-470f-8bf6-b624620b212b req-b556894b-b6a3-4c2b-b451-58ae2ea205a1 tempest-AttachVolumeTestJSON-984626347 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:10:31.095811 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-6d1f0bdd-8380-41a4-b159-e9d2ec07ffd9 tempest-AttachVolumeShelveTestJSON-1635390820 None] Created volume successfully.
Oct 29 21:10:32.569534 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-12b968cd-3572-470f-8bf6-b624620b212b req-b556894b-b6a3-4c2b-b451-58ae2ea205a1 tempest-AttachVolumeTestJSON-984626347 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.517s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:10:32.570758 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-12b968cd-3572-470f-8bf6-b624620b212b req-b556894b-b6a3-4c2b-b451-58ae2ea205a1 tempest-AttachVolumeTestJSON-984626347 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c70004a7-678b-41f5-81b6-131c2e4d9d74', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'c70004a7-678b-41f5-81b6-131c2e4d9d74', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:10:32.637870 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-12b968cd-3572-470f-8bf6-b624620b212b req-b556894b-b6a3-4c2b-b451-58ae2ea205a1 tempest-AttachVolumeTestJSON-984626347 None] Connection info returned from driver {'name': 'volumes/volume-c70004a7-678b-41f5-81b6-131c2e4d9d74', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c70004a7-678b-41f5-81b6-131c2e4d9d74', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '94bd6316-b34d-47d2-a95d-a17d62a0c76e'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:10:32.750549 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-12b968cd-3572-470f-8bf6-b624620b212b req-b556894b-b6a3-4c2b-b451-58ae2ea205a1 tempest-AttachVolumeTestJSON-984626347 None] attachment_update completed successfully.
Oct 29 21:10:37.065112 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:10:37.151368 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Flow 'volume_create_manager' (bd9f2989-683a-44ae-98de-b63ed84b0248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:10:37.161380 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ac015a-c263-4834-a9de-cd359ca20d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:37.196603 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ac015a-c263-4834-a9de-cd359ca20d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-937015532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8eed2fcb-75eb-49b5-94a6-487c9edfd8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='208de26bb7304ee793bac715fb73fbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:10:37Z,use_quota=True,user_id='04d3c643e9c245eeaa6328d22184bc00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:37.206896 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1fa41f-3cdc-4b8d-b3ae-00af8fd72c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:37.211604 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1fa41f-3cdc-4b8d-b3ae-00af8fd72c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:37.218318 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575c9dc4-1829-4f0c-88db-a3d03c316f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:37.223413 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (575c9dc4-1829-4f0c-88db-a3d03c316f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eed2fcb-75eb-49b5-94a6-487c9edfd8fb', 'volume_name': 'volume-8eed2fcb-75eb-49b5-94a6-487c9edfd8fb', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:37.230062 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e40fce0-bb1c-4711-bd8e-2e16794daf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:37.243423 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e40fce0-bb1c-4711-bd8e-2e16794daf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:37.257432 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44812c20-e335-4c98-ab9b-491a14db394f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:37.259798 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Volume 8eed2fcb-75eb-49b5-94a6-487c9edfd8fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eed2fcb-75eb-49b5-94a6-487c9edfd8fb', 'volume_size': 1}
Oct 29 21:10:37.262630 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] creating volume 'volume-8eed2fcb-75eb-49b5-94a6-487c9edfd8fb' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:10:37.263688 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:10:37.444344 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:10:37.444785 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:10:37.454880 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44812c20-e335-4c98-ab9b-491a14db394f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eed2fcb-75eb-49b5-94a6-487c9edfd8fb', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:37.462062 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2204e9-aeff-4b8e-83d1-a4a07d4cbecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:10:37.485817 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Volume volume-8eed2fcb-75eb-49b5-94a6-487c9edfd8fb (8eed2fcb-75eb-49b5-94a6-487c9edfd8fb): created successfully
Oct 29 21:10:37.490284 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2204e9-aeff-4b8e-83d1-a4a07d4cbecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:10:37.497001 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Flow 'volume_create_manager' (bd9f2989-683a-44ae-98de-b63ed84b0248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:10:37.511067 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-2993452e-5fcb-4cc6-b975-d10e8d9390a3 tempest-AttachVolumeTestJSON-984626347 None] Created volume successfully.
Oct 29 21:10:39.437953 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-939b9177-b20d-43ab-981b-3cb8a79e847a req-d03bb48b-1e31-4ac9-be7d-10a44964a911 tempest-AttachVolumeTestJSON-984626347 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:10:41.590752 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-939b9177-b20d-43ab-981b-3cb8a79e847a req-d03bb48b-1e31-4ac9-be7d-10a44964a911 tempest-AttachVolumeTestJSON-984626347 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.154s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:10:41.592088 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-939b9177-b20d-43ab-981b-3cb8a79e847a req-d03bb48b-1e31-4ac9-be7d-10a44964a911 tempest-AttachVolumeTestJSON-984626347 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8eed2fcb-75eb-49b5-94a6-487c9edfd8fb', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '8eed2fcb-75eb-49b5-94a6-487c9edfd8fb', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:10:41.639503 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-939b9177-b20d-43ab-981b-3cb8a79e847a req-d03bb48b-1e31-4ac9-be7d-10a44964a911 tempest-AttachVolumeTestJSON-984626347 None] Connection info returned from driver {'name': 'volumes/volume-8eed2fcb-75eb-49b5-94a6-487c9edfd8fb', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8eed2fcb-75eb-49b5-94a6-487c9edfd8fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2a6ee564-4ce9-410e-92c0-1d6d8d2ad1d2'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:10:41.737432 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-939b9177-b20d-43ab-981b-3cb8a79e847a req-d03bb48b-1e31-4ac9-be7d-10a44964a911 tempest-AttachVolumeTestJSON-984626347 None] attachment_update completed successfully.
Oct 29 21:10:47.410328 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-fc625576-e0b2-4e23-b770-e19dc27774e4 req-24723aa6-c42b-432f-998e-5f3b59899cfb tempest-AttachVolumeTestJSON-984626347 None] Terminate volume connection completed successfully.
Oct 29 21:10:47.410998 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-fc625576-e0b2-4e23-b770-e19dc27774e4 req-24723aa6-c42b-432f-998e-5f3b59899cfb tempest-AttachVolumeTestJSON-984626347 None] Deleting attachment 94bd6316-b34d-47d2-a95d-a17d62a0c76e. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:10:50.079926 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-da2fc4c4-7c80-4fa6-bf6b-599415f47a3c req-100beb1c-52f8-4d5a-835b-d632d32cc76c tempest-AttachVolumeTestJSON-984626347 None] Terminate volume connection completed successfully.
Oct 29 21:10:50.081128 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-da2fc4c4-7c80-4fa6-bf6b-599415f47a3c req-100beb1c-52f8-4d5a-835b-d632d32cc76c tempest-AttachVolumeTestJSON-984626347 None] Deleting attachment 2a6ee564-4ce9-410e-92c0-1d6d8d2ad1d2. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:11:01.389635 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:11:01.391032 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:01.461102 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:01.541599 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:11:02.618491 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=49,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:11:02.619233 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=3,cinder:SELECT=35,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:11:04.082692 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9a1a59b0-e465-4050-a571-de7be9441f8b tempest-AttachVolumeTestJSON-984626347 None] Acquiring lock "cinder-8eed2fcb-75eb-49b5-94a6-487c9edfd8fb-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:11:04.098098 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9a1a59b0-e465-4050-a571-de7be9441f8b tempest-AttachVolumeTestJSON-984626347 None] Lock "cinder-8eed2fcb-75eb-49b5-94a6-487c9edfd8fb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:11:04.248140 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9a1a59b0-e465-4050-a571-de7be9441f8b tempest-AttachVolumeTestJSON-984626347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:04.375717 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9a1a59b0-e465-4050-a571-de7be9441f8b tempest-AttachVolumeTestJSON-984626347 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:11:04.376413 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9a1a59b0-e465-4050-a571-de7be9441f8b tempest-AttachVolumeTestJSON-984626347 None] Volume volume-8eed2fcb-75eb-49b5-94a6-487c9edfd8fb is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:11:04.392264 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9a1a59b0-e465-4050-a571-de7be9441f8b tempest-AttachVolumeTestJSON-984626347 None] deleting rbd volume volume-8eed2fcb-75eb-49b5-94a6-487c9edfd8fb {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:11:04.873995 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-9a1a59b0-e465-4050-a571-de7be9441f8b tempest-AttachVolumeTestJSON-984626347 None] Created reservations ['56583e94-6710-4d3a-a1eb-0fd4e1d1a2b9', '823712b4-feeb-429d-9164-ef51a8cc5f51', '41ad7e98-51f7-4067-a110-d080d78151ad', '9c8670c0-9a85-4ecd-9029-423b8b074288'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:11:04.998175 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9a1a59b0-e465-4050-a571-de7be9441f8b tempest-AttachVolumeTestJSON-984626347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:05.119456 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9a1a59b0-e465-4050-a571-de7be9441f8b tempest-AttachVolumeTestJSON-984626347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:05.242770 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-9a1a59b0-e465-4050-a571-de7be9441f8b tempest-AttachVolumeTestJSON-984626347 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:11:05.249226 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-9a1a59b0-e465-4050-a571-de7be9441f8b tempest-AttachVolumeTestJSON-984626347 None] Deleted volume successfully.
Oct 29 21:11:05.299847 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9a1a59b0-e465-4050-a571-de7be9441f8b tempest-AttachVolumeTestJSON-984626347 None] Lock "cinder-8eed2fcb-75eb-49b5-94a6-487c9edfd8fb-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:11:05.366416 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-682b7c01-9b06-4933-93b2-4242eda5b981 tempest-AttachVolumeTestJSON-984626347 None] Acquiring lock "cinder-c70004a7-678b-41f5-81b6-131c2e4d9d74-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:11:05.388183 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-682b7c01-9b06-4933-93b2-4242eda5b981 tempest-AttachVolumeTestJSON-984626347 None] Lock "cinder-c70004a7-678b-41f5-81b6-131c2e4d9d74-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:11:05.596737 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-682b7c01-9b06-4933-93b2-4242eda5b981 tempest-AttachVolumeTestJSON-984626347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:05.725058 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-682b7c01-9b06-4933-93b2-4242eda5b981 tempest-AttachVolumeTestJSON-984626347 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:11:05.725923 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-682b7c01-9b06-4933-93b2-4242eda5b981 tempest-AttachVolumeTestJSON-984626347 None] Volume volume-c70004a7-678b-41f5-81b6-131c2e4d9d74 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:11:05.738251 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-682b7c01-9b06-4933-93b2-4242eda5b981 tempest-AttachVolumeTestJSON-984626347 None] deleting rbd volume volume-c70004a7-678b-41f5-81b6-131c2e4d9d74 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:11:06.222900 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-682b7c01-9b06-4933-93b2-4242eda5b981 tempest-AttachVolumeTestJSON-984626347 None] Created reservations ['82e9a2fc-52d4-4558-a8ae-7baf9e2885f3', 'ea1e08ff-1ae8-4487-b8b1-50fc041ef344', '4d2dd261-4260-4b93-bcb8-328c971dcd79', 'f51b0846-01c1-4cf6-a4c2-ef1c9e2dd337'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:11:06.409275 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-682b7c01-9b06-4933-93b2-4242eda5b981 tempest-AttachVolumeTestJSON-984626347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:06.507636 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-682b7c01-9b06-4933-93b2-4242eda5b981 tempest-AttachVolumeTestJSON-984626347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:06.649857 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-682b7c01-9b06-4933-93b2-4242eda5b981 tempest-AttachVolumeTestJSON-984626347 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:11:06.655349 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-682b7c01-9b06-4933-93b2-4242eda5b981 tempest-AttachVolumeTestJSON-984626347 None] Deleted volume successfully.
Oct 29 21:11:06.683412 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-682b7c01-9b06-4933-93b2-4242eda5b981 tempest-AttachVolumeTestJSON-984626347 None] Lock "cinder-c70004a7-678b-41f5-81b6-131c2e4d9d74-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:11:06.912845 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-d07bc798-7a65-4ad3-89b0-2bebd22420e3 tempest-AttachVolumeTestJSON-984626347 None] Acquiring lock "cinder-c40a99ee-b65d-4555-8a47-9a9439c99cae-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:11:06.928656 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-d07bc798-7a65-4ad3-89b0-2bebd22420e3 tempest-AttachVolumeTestJSON-984626347 None] Lock "cinder-c40a99ee-b65d-4555-8a47-9a9439c99cae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:11:07.038331 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d07bc798-7a65-4ad3-89b0-2bebd22420e3 tempest-AttachVolumeTestJSON-984626347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:07.153857 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d07bc798-7a65-4ad3-89b0-2bebd22420e3 tempest-AttachVolumeTestJSON-984626347 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:11:07.154575 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d07bc798-7a65-4ad3-89b0-2bebd22420e3 tempest-AttachVolumeTestJSON-984626347 None] Volume volume-c40a99ee-b65d-4555-8a47-9a9439c99cae is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:11:07.181336 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d07bc798-7a65-4ad3-89b0-2bebd22420e3 tempest-AttachVolumeTestJSON-984626347 None] deleting rbd volume volume-c40a99ee-b65d-4555-8a47-9a9439c99cae {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:11:07.616281 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-d07bc798-7a65-4ad3-89b0-2bebd22420e3 tempest-AttachVolumeTestJSON-984626347 None] Created reservations ['ba303fc2-3386-4385-96d3-dd2974d417df', '51f5e2cd-0d6d-4e66-b5e7-290184d4a9da', '3262be11-8e6a-4a58-933d-0262edc9ad72', '4d40f0e2-0052-44b7-a9eb-d8f17ddac036'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:11:07.817716 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d07bc798-7a65-4ad3-89b0-2bebd22420e3 tempest-AttachVolumeTestJSON-984626347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:07.867478 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d07bc798-7a65-4ad3-89b0-2bebd22420e3 tempest-AttachVolumeTestJSON-984626347 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:08.023270 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-d07bc798-7a65-4ad3-89b0-2bebd22420e3 tempest-AttachVolumeTestJSON-984626347 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:11:08.033304 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-d07bc798-7a65-4ad3-89b0-2bebd22420e3 tempest-AttachVolumeTestJSON-984626347 None] Deleted volume successfully.
Oct 29 21:11:08.063436 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-d07bc798-7a65-4ad3-89b0-2bebd22420e3 tempest-AttachVolumeTestJSON-984626347 None] Lock "cinder-c40a99ee-b65d-4555-8a47-9a9439c99cae-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:11:22.621310 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=46,cinder:INSERT=6,cinder:UPDATE=27 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:11:30.568705 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-62259470-b9c5-41d3-a374-0111f41ab03e tempest-BackendsCapabilitiesAdminTestsJSON-1488924115 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:75c89f35-4e51-4f7b-b3a2-c1f0fe460410:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=131780) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4776}}
Oct 29 21:11:30.627576 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ee9a8c14-6532-4b94-b557-cb85cf0e2a77 tempest-BackendsCapabilitiesAdminTestsJSON-1488924115 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.3.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:75c89f35-4e51-4f7b-b3a2-c1f0fe460410:cinder:volumes', 'backend_state': 'up', 'qos_support': True, 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=131780) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4776}}
Oct 29 21:11:32.650012 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=33,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:11:37.170433 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-fa93ed87-8cc6-462e-963b-44c6d3ec5bfc req-19f9b176-00de-4478-ba2f-372f19d61fda tempest-AttachVolumeShelveTestJSON-1635390820 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:11:38.912772 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-fa93ed87-8cc6-462e-963b-44c6d3ec5bfc req-19f9b176-00de-4478-ba2f-372f19d61fda tempest-AttachVolumeShelveTestJSON-1635390820 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.744s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:11:38.914658 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-fa93ed87-8cc6-462e-963b-44c6d3ec5bfc req-19f9b176-00de-4478-ba2f-372f19d61fda tempest-AttachVolumeShelveTestJSON-1635390820 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e7628d78-193e-456e-ab22-7607b628008d', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'e7628d78-193e-456e-ab22-7607b628008d', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:11:38.969575 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-fa93ed87-8cc6-462e-963b-44c6d3ec5bfc req-19f9b176-00de-4478-ba2f-372f19d61fda tempest-AttachVolumeShelveTestJSON-1635390820 None] Connection info returned from driver {'name': 'volumes/volume-e7628d78-193e-456e-ab22-7607b628008d', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e7628d78-193e-456e-ab22-7607b628008d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8704d2f3-7957-47f2-9f46-1e6a660389a0'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:11:39.128231 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-fa93ed87-8cc6-462e-963b-44c6d3ec5bfc req-19f9b176-00de-4478-ba2f-372f19d61fda tempest-AttachVolumeShelveTestJSON-1635390820 None] attachment_update completed successfully.
Oct 29 21:11:39.535062 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:11:39.596369 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Flow 'volume_create_manager' (a27ed6fe-12e7-4da9-8eee-3290730f4223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:11:39.622019 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b574ba3-b18f-46ed-8cc2-703009ff8a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:11:39.652812 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b574ba3-b18f-46ed-8cc2-703009ff8a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-246350980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bd818d87-dbf5-4c10-ae72-3dad31f435b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b740f6e3e2474ba4820478a6e925c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:11:39Z,use_quota=True,user_id='307edf5866354920b541ea61adaedc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19033cd2-9f23-40bc-a441-8f4cc57f5c87),volume_type_id=19033cd2-9f23-40bc-a441-8f4cc57f5c87)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:11:39.660659 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6244b9c-1386-4ba4-8943-aa01f7dcb6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:11:39.665650 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6244b9c-1386-4ba4-8943-aa01f7dcb6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:11:39.679999 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e8fa51-64a5-473f-bc87-2ac1a15f9da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:11:39.687757 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e8fa51-64a5-473f-bc87-2ac1a15f9da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd818d87-dbf5-4c10-ae72-3dad31f435b1', 'volume_name': 'volume-bd818d87-dbf5-4c10-ae72-3dad31f435b1', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:11:39.694064 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ba3a98-96f2-4426-b19e-5996f20a94a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:11:39.699099 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ba3a98-96f2-4426-b19e-5996f20a94a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:11:39.705903 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd77e4c5-0604-4dbd-bea0-42d5ae7f649d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:11:39.707378 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Volume bd818d87-dbf5-4c10-ae72-3dad31f435b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd818d87-dbf5-4c10-ae72-3dad31f435b1', 'volume_size': 1}
Oct 29 21:11:39.708157 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] creating volume 'volume-bd818d87-dbf5-4c10-ae72-3dad31f435b1' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:11:39.709562 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:39.834390 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] extra_specs: {} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:11:39.834772 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] extra_specs: {} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:11:39.838560 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd77e4c5-0604-4dbd-bea0-42d5ae7f649d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd818d87-dbf5-4c10-ae72-3dad31f435b1', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:11:39.856608 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a23910a7-23c1-4614-a7d9-57ffe1b62783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:11:39.890034 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Volume volume-bd818d87-dbf5-4c10-ae72-3dad31f435b1 (bd818d87-dbf5-4c10-ae72-3dad31f435b1): created successfully
Oct 29 21:11:39.893732 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a23910a7-23c1-4614-a7d9-57ffe1b62783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:11:39.911442 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Flow 'volume_create_manager' (a27ed6fe-12e7-4da9-8eee-3290730f4223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:11:39.953360 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-33c72682-afa8-498a-bc40-a97fc526d617 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Created volume successfully.
Oct 29 21:11:41.448851 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3fd8c2fc-7d29-4946-b71d-05f6af686f99 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:41.545268 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3fd8c2fc-7d29-4946-b71d-05f6af686f99 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:41.673213 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-3fd8c2fc-7d29-4946-b71d-05f6af686f99 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:11:41.683878 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-3fd8c2fc-7d29-4946-b71d-05f6af686f99 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Retype volume completed successfully.
Oct 29 21:11:42.922410 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-004364eb-95da-4ce5-92d8-97d25cb49259 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Acquiring lock "cinder-bd818d87-dbf5-4c10-ae72-3dad31f435b1-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:11:42.932702 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-004364eb-95da-4ce5-92d8-97d25cb49259 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Lock "cinder-bd818d87-dbf5-4c10-ae72-3dad31f435b1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:11:43.036278 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-004364eb-95da-4ce5-92d8-97d25cb49259 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:43.151555 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-004364eb-95da-4ce5-92d8-97d25cb49259 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:11:43.152021 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-004364eb-95da-4ce5-92d8-97d25cb49259 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Volume volume-bd818d87-dbf5-4c10-ae72-3dad31f435b1 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:11:43.164109 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-004364eb-95da-4ce5-92d8-97d25cb49259 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] deleting rbd volume volume-bd818d87-dbf5-4c10-ae72-3dad31f435b1 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:11:43.634447 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-004364eb-95da-4ce5-92d8-97d25cb49259 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:11:43.636315 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-004364eb-95da-4ce5-92d8-97d25cb49259 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:11:43.668904 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-004364eb-95da-4ce5-92d8-97d25cb49259 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Created reservations ['c21eed31-e2cc-426a-bb96-ac79dc98ace9', '61f151ed-608c-4bc4-8a98-111451e42371', '5a551739-5425-4409-ad8b-5887875d97cc', '11510af9-cc8e-4975-8fe7-debcc26bb0b1'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:11:43.823543 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-004364eb-95da-4ce5-92d8-97d25cb49259 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:43.951768 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-004364eb-95da-4ce5-92d8-97d25cb49259 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:11:44.041597 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-004364eb-95da-4ce5-92d8-97d25cb49259 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:11:44.050929 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-004364eb-95da-4ce5-92d8-97d25cb49259 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Deleted volume successfully.
Oct 29 21:11:44.089966 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-004364eb-95da-4ce5-92d8-97d25cb49259 tempest-VolumeRetypeWithoutMigrationTest-1721289871 None] Lock "cinder-bd818d87-dbf5-4c10-ae72-3dad31f435b1-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:12:01.389489 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:12:01.390796 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:01.458365 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:01.563872 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:12:02.625538 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=47,cinder:UPDATE=18,cinder:INSERT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:12:12.632124 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=42,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:12:14.812279 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:12:14.853389 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Flow 'volume_create_manager' (1a951f80-599b-41ed-a74c-0ea08bbc7dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:14.865441 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6a218b-0e5b-4f71-b157-48e1b1bfcea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:14.901611 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6a218b-0e5b-4f71-b157-48e1b1bfcea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1971380102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=549ec351-5b25-4106-9859-40818545d806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94eb98816af54409a6b38a839820cb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:12:15Z,use_quota=True,user_id='08c20f9f18f84b1f87b8d3be7ef379e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:14.912630 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c16200-e34a-46b9-be98-511f546e2e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:14.917308 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c16200-e34a-46b9-be98-511f546e2e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:14.936317 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9faaf4a-69ab-4ffa-aa7d-b7e7b312bd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:14.943188 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9faaf4a-69ab-4ffa-aa7d-b7e7b312bd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549ec351-5b25-4106-9859-40818545d806', 'volume_name': 'volume-549ec351-5b25-4106-9859-40818545d806', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:14.952037 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b863cb5a-2eba-4d0f-b857-97af091ba59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:14.958056 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b863cb5a-2eba-4d0f-b857-97af091ba59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:14.964204 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e975428-21f5-4039-9867-fbe5c65dd357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:14.966365 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Volume 549ec351-5b25-4106-9859-40818545d806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549ec351-5b25-4106-9859-40818545d806', 'volume_size': 1}
Oct 29 21:12:14.966908 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] creating volume 'volume-549ec351-5b25-4106-9859-40818545d806' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:12:14.969757 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:15.080211 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:12:15.080723 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:12:15.086789 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e975428-21f5-4039-9867-fbe5c65dd357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549ec351-5b25-4106-9859-40818545d806', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:15.093117 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04340de0-1213-4071-bf96-49388a8008e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:15.127168 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Volume volume-549ec351-5b25-4106-9859-40818545d806 (549ec351-5b25-4106-9859-40818545d806): created successfully
Oct 29 21:12:15.139635 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04340de0-1213-4071-bf96-49388a8008e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:15.155799 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Flow 'volume_create_manager' (1a951f80-599b-41ed-a74c-0ea08bbc7dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:15.178673 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4d512082-7a1c-4baf-8730-ca5fb1a34a0c tempest-VolumesMetadataTest-1296150628 None] Created volume successfully.
Oct 29 21:12:16.938874 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f10c5241-b96a-49ff-9961-506610cecf7c tempest-VolumesMetadataTest-1296150628 None] Acquiring lock "cinder-549ec351-5b25-4106-9859-40818545d806-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:12:16.952761 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f10c5241-b96a-49ff-9961-506610cecf7c tempest-VolumesMetadataTest-1296150628 None] Lock "cinder-549ec351-5b25-4106-9859-40818545d806-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:12:17.037184 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f10c5241-b96a-49ff-9961-506610cecf7c tempest-VolumesMetadataTest-1296150628 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:17.147123 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f10c5241-b96a-49ff-9961-506610cecf7c tempest-VolumesMetadataTest-1296150628 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:12:17.147562 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f10c5241-b96a-49ff-9961-506610cecf7c tempest-VolumesMetadataTest-1296150628 None] Volume volume-549ec351-5b25-4106-9859-40818545d806 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:12:17.156003 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f10c5241-b96a-49ff-9961-506610cecf7c tempest-VolumesMetadataTest-1296150628 None] deleting rbd volume volume-549ec351-5b25-4106-9859-40818545d806 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:12:17.581295 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-f10c5241-b96a-49ff-9961-506610cecf7c tempest-VolumesMetadataTest-1296150628 None] Created reservations ['5e7dcac9-fad8-43e5-a6c7-e00ebca18684', '6b4d9f74-da83-4e27-a9cc-318178f600e3', 'ddb7cdbe-3697-4b28-bb9a-78560f1d82b1', '580ffd85-e5b4-4a33-91ef-842838716792'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:12:17.653338 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f10c5241-b96a-49ff-9961-506610cecf7c tempest-VolumesMetadataTest-1296150628 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:17.705928 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f10c5241-b96a-49ff-9961-506610cecf7c tempest-VolumesMetadataTest-1296150628 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:17.758187 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-f10c5241-b96a-49ff-9961-506610cecf7c tempest-VolumesMetadataTest-1296150628 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:12:17.764610 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f10c5241-b96a-49ff-9961-506610cecf7c tempest-VolumesMetadataTest-1296150628 None] Deleted volume successfully.
Oct 29 21:12:17.784977 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f10c5241-b96a-49ff-9961-506610cecf7c tempest-VolumesMetadataTest-1296150628 None] Lock "cinder-549ec351-5b25-4106-9859-40818545d806-delete_volume" released by "delete_volume" :: held 0.832s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:12:24.637875 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:12:24.662604 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Flow 'volume_create_manager' (23f95559-332f-4f5e-a7a5-bf7b9ba30440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:24.669375 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e816f21-a530-424d-ba1b-64798bef6fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:24.696204 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e816f21-a530-424d-ba1b-64798bef6fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-406719874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f255016-81a1-4713-b8ab-8eba1a7cf8c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc53eec3c5e46bca58aacba40b1a8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:12:25Z,use_quota=True,user_id='174d797b5bf448c38e764d99191d212e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:24.703198 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462c2ed4-4ef6-45b1-af8f-eb4b7e613d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:24.708917 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462c2ed4-4ef6-45b1-af8f-eb4b7e613d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:24.714569 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86ea0b0-2e18-4a43-af30-4358365b686f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:24.720044 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f86ea0b0-2e18-4a43-af30-4358365b686f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f255016-81a1-4713-b8ab-8eba1a7cf8c8', 'volume_name': 'volume-2f255016-81a1-4713-b8ab-8eba1a7cf8c8', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:24.726062 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ee4855-6e08-4321-91c1-75807b8541fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:24.732083 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ee4855-6e08-4321-91c1-75807b8541fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:24.739599 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f219354b-bb21-4237-84c6-28ac0e0f4142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:24.740969 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Volume 2f255016-81a1-4713-b8ab-8eba1a7cf8c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f255016-81a1-4713-b8ab-8eba1a7cf8c8', 'volume_size': 1}
Oct 29 21:12:24.741426 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] creating volume 'volume-2f255016-81a1-4713-b8ab-8eba1a7cf8c8' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:12:24.742272 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:24.853220 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:12:24.853882 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:12:24.858673 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f219354b-bb21-4237-84c6-28ac0e0f4142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f255016-81a1-4713-b8ab-8eba1a7cf8c8', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:24.864577 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76324d1-1963-4cb4-b63d-f989301f79b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:24.877798 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Volume volume-2f255016-81a1-4713-b8ab-8eba1a7cf8c8 (2f255016-81a1-4713-b8ab-8eba1a7cf8c8): created successfully
Oct 29 21:12:24.884013 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76324d1-1963-4cb4-b63d-f989301f79b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:24.892622 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Flow 'volume_create_manager' (23f95559-332f-4f5e-a7a5-bf7b9ba30440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:24.907075 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b0a69f29-10c7-487a-8d12-1b03c8a574fd tempest-VolumesTransfersV355Test-1423482978 None] Created volume successfully.
Oct 29 21:12:27.040033 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1707a798-b5c1-4bef-930a-3275e323fc38 tempest-VolumesTransfersV355Test-1536160596 None] Transfer volume completed successfully.
Oct 29 21:12:28.013040 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-6f74721d-5ad0-4284-b8a9-10d18a830da7 tempest-VolumesTransfersV355Test-585961800 None] Acquiring lock "cinder-2f255016-81a1-4713-b8ab-8eba1a7cf8c8-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:12:28.033787 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-6f74721d-5ad0-4284-b8a9-10d18a830da7 tempest-VolumesTransfersV355Test-585961800 None] Lock "cinder-2f255016-81a1-4713-b8ab-8eba1a7cf8c8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:12:28.099840 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6f74721d-5ad0-4284-b8a9-10d18a830da7 tempest-VolumesTransfersV355Test-585961800 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:28.220060 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6f74721d-5ad0-4284-b8a9-10d18a830da7 tempest-VolumesTransfersV355Test-585961800 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:12:28.220926 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6f74721d-5ad0-4284-b8a9-10d18a830da7 tempest-VolumesTransfersV355Test-585961800 None] Volume volume-2f255016-81a1-4713-b8ab-8eba1a7cf8c8 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:12:28.225959 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6f74721d-5ad0-4284-b8a9-10d18a830da7 tempest-VolumesTransfersV355Test-585961800 None] deleting rbd volume volume-2f255016-81a1-4713-b8ab-8eba1a7cf8c8 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:12:28.645692 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-6f74721d-5ad0-4284-b8a9-10d18a830da7 tempest-VolumesTransfersV355Test-585961800 None] Created reservations ['b438ac64-8006-4411-9516-b6c1129603ea', 'd9be24c7-2848-4ef3-82f8-581bdfc6ccde', '808cc072-b70d-40f2-9879-5207f5972e1b', 'bbdcae7f-f1c6-43c5-be2f-1197e9f691ea'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:12:28.758936 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6f74721d-5ad0-4284-b8a9-10d18a830da7 tempest-VolumesTransfersV355Test-585961800 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:28.830855 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6f74721d-5ad0-4284-b8a9-10d18a830da7 tempest-VolumesTransfersV355Test-585961800 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:28.935098 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-6f74721d-5ad0-4284-b8a9-10d18a830da7 tempest-VolumesTransfersV355Test-585961800 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:12:28.941977 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-6f74721d-5ad0-4284-b8a9-10d18a830da7 tempest-VolumesTransfersV355Test-585961800 None] Deleted volume successfully.
Oct 29 21:12:28.962375 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-6f74721d-5ad0-4284-b8a9-10d18a830da7 tempest-VolumesTransfersV355Test-585961800 None] Lock "cinder-2f255016-81a1-4713-b8ab-8eba1a7cf8c8-delete_volume" released by "delete_volume" :: held 0.929s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:12:29.874223 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:12:29.898875 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Flow 'volume_create_manager' (07a8a447-b218-48aa-a897-5274cd0359a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:29.907610 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ed7a99-6e6c-4e20-a821-73730f9640ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:29.927469 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ed7a99-6e6c-4e20-a821-73730f9640ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1561243778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=924cfd1e-c660-4793-a05a-57cc98da8c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abc53eec3c5e46bca58aacba40b1a8f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:12:30Z,use_quota=True,user_id='174d797b5bf448c38e764d99191d212e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:29.934985 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec09a600-c93b-4f26-b4cb-d58db9ef9ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:29.939735 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec09a600-c93b-4f26-b4cb-d58db9ef9ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:29.947991 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44487943-2384-42eb-a1a9-7d47bf488c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:29.955247 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44487943-2384-42eb-a1a9-7d47bf488c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '924cfd1e-c660-4793-a05a-57cc98da8c88', 'volume_name': 'volume-924cfd1e-c660-4793-a05a-57cc98da8c88', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:29.961032 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52e8440-a6e0-4f1a-b017-f8fd6cdbe445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:29.967420 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52e8440-a6e0-4f1a-b017-f8fd6cdbe445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:29.975513 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3189ed7-0e1e-4c4f-8454-66186298afd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:29.976920 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Volume 924cfd1e-c660-4793-a05a-57cc98da8c88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-924cfd1e-c660-4793-a05a-57cc98da8c88', 'volume_size': 1}
Oct 29 21:12:29.977984 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] creating volume 'volume-924cfd1e-c660-4793-a05a-57cc98da8c88' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:12:29.978952 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:30.097130 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:12:30.097634 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:12:30.102974 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3189ed7-0e1e-4c4f-8454-66186298afd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-924cfd1e-c660-4793-a05a-57cc98da8c88', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:30.112563 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922b03b1-6f1b-4466-a912-d2a68848e778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:30.136155 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Volume volume-924cfd1e-c660-4793-a05a-57cc98da8c88 (924cfd1e-c660-4793-a05a-57cc98da8c88): created successfully
Oct 29 21:12:30.139963 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922b03b1-6f1b-4466-a912-d2a68848e778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:30.156686 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Flow 'volume_create_manager' (07a8a447-b218-48aa-a897-5274cd0359a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:30.173874 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f770f152-1bb0-4b5a-9f5b-d80d6dc8c73f tempest-VolumesTransfersV355Test-1423482978 None] Created volume successfully.
Oct 29 21:12:31.599899 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-da9ce5a5-bcf8-4097-be22-4d56db570f5c tempest-VolumesTransfersV355Test-585961800 None] Acquiring lock "cinder-924cfd1e-c660-4793-a05a-57cc98da8c88-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:12:31.626734 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-da9ce5a5-bcf8-4097-be22-4d56db570f5c tempest-VolumesTransfersV355Test-585961800 None] Lock "cinder-924cfd1e-c660-4793-a05a-57cc98da8c88-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:12:31.717722 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-da9ce5a5-bcf8-4097-be22-4d56db570f5c tempest-VolumesTransfersV355Test-585961800 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:31.799742 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-da9ce5a5-bcf8-4097-be22-4d56db570f5c tempest-VolumesTransfersV355Test-585961800 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:12:31.800485 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-da9ce5a5-bcf8-4097-be22-4d56db570f5c tempest-VolumesTransfersV355Test-585961800 None] Volume volume-924cfd1e-c660-4793-a05a-57cc98da8c88 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:12:31.810531 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-da9ce5a5-bcf8-4097-be22-4d56db570f5c tempest-VolumesTransfersV355Test-585961800 None] deleting rbd volume volume-924cfd1e-c660-4793-a05a-57cc98da8c88 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:12:32.238920 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-da9ce5a5-bcf8-4097-be22-4d56db570f5c tempest-VolumesTransfersV355Test-585961800 None] Created reservations ['1b6b5104-c28c-4534-95e8-eb50ff983491', '32eda698-6dc5-4142-94c6-0fe1becb0029', 'e7ab6b28-e839-4f60-b4c4-fb9673d35606', 'c5dde33b-3ded-49eb-8e2c-c111ea3d5b9d'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:12:32.359046 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-da9ce5a5-bcf8-4097-be22-4d56db570f5c tempest-VolumesTransfersV355Test-585961800 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:32.475675 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-da9ce5a5-bcf8-4097-be22-4d56db570f5c tempest-VolumesTransfersV355Test-585961800 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:32.563241 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-da9ce5a5-bcf8-4097-be22-4d56db570f5c tempest-VolumesTransfersV355Test-585961800 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:12:32.571597 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-da9ce5a5-bcf8-4097-be22-4d56db570f5c tempest-VolumesTransfersV355Test-585961800 None] Deleted volume successfully.
Oct 29 21:12:32.607373 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-da9ce5a5-bcf8-4097-be22-4d56db570f5c tempest-VolumesTransfersV355Test-585961800 None] Lock "cinder-924cfd1e-c660-4793-a05a-57cc98da8c88-delete_volume" released by "delete_volume" :: held 0.980s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:12:32.644245 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=57,cinder:UPDATE=35,cinder:DELETE=3,cinder:INSERT=5 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:12:39.225370 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=44,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:12:39.236544 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:12:39.263264 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Flow 'volume_create_manager' (ec6b2b08-e3db-4990-8fe2-8c0fa7426a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:39.270115 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9276ce-5477-4b7d-9597-3b3aaf52d5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:39.287707 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9276ce-5477-4b7d-9597-3b3aaf52d5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-624071902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ba439e29-d4ab-4496-8288-3803f6f7dc81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d59fa3145348278dab984bcc3a774e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:12:39Z,use_quota=True,user_id='48cba316df814845af9f1116997c8b5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:39.293691 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ab296e-0481-4f1e-a518-658680ac9f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:39.297757 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ab296e-0481-4f1e-a518-658680ac9f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:39.303425 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a74e12-fd5d-4634-b181-bfd6b90906b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:39.310548 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a74e12-fd5d-4634-b181-bfd6b90906b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba439e29-d4ab-4496-8288-3803f6f7dc81', 'volume_name': 'volume-ba439e29-d4ab-4496-8288-3803f6f7dc81', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:39.315265 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2508824-b165-4388-9940-5fb091da001b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:39.319419 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2508824-b165-4388-9940-5fb091da001b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:39.324315 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed76c8b9-6916-4c4a-b9b7-9aadeb719c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:39.325531 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Volume ba439e29-d4ab-4496-8288-3803f6f7dc81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba439e29-d4ab-4496-8288-3803f6f7dc81', 'volume_size': 1}
Oct 29 21:12:39.326144 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] creating volume 'volume-ba439e29-d4ab-4496-8288-3803f6f7dc81' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:12:39.327039 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:39.436474 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:12:39.437144 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:12:39.441300 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed76c8b9-6916-4c4a-b9b7-9aadeb719c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba439e29-d4ab-4496-8288-3803f6f7dc81', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:39.447860 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3e5d42-4dd9-4ddf-976f-108c6670922f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:39.461889 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Volume volume-ba439e29-d4ab-4496-8288-3803f6f7dc81 (ba439e29-d4ab-4496-8288-3803f6f7dc81): created successfully
Oct 29 21:12:39.471683 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3e5d42-4dd9-4ddf-976f-108c6670922f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:39.483518 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Flow 'volume_create_manager' (ec6b2b08-e3db-4990-8fe2-8c0fa7426a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:39.499908 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-e35ac694-0bce-4667-b258-32b2aa719338 tempest-VolumesBackupsV39Test-1989329621 None] Created volume successfully.
Oct 29 21:12:40.650070 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7910e2b1-4598-4d82-ae1f-167fadadead9 tempest-VolumesBackupsV39Test-1989329621 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-29T21:12:40Z,data_timestamp=2022-10-29T21:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-2104158358',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=b32d972f-452a-4227-b7c1-c19209399a98,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='77d59fa3145348278dab984bcc3a774e',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='48cba316df814845af9f1116997c8b5e',volume_id=ba439e29-d4ab-4496-8288-3803f6f7dc81)
Oct 29 21:12:40.673510 ncdv-master-1 cinder-volume[131780]: INFO cinder.rpc [None req-7910e2b1-4598-4d82-ae1f-167fadadead9 tempest-VolumesBackupsV39Test-1989329621 None] Automatically selected cinder-backup objects version 1.39 as minimum service version.
Oct 29 21:12:40.687702 ncdv-master-1 cinder-volume[131780]: INFO cinder.rpc [None req-7910e2b1-4598-4d82-ae1f-167fadadead9 tempest-VolumesBackupsV39Test-1989329621 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version.
Oct 29 21:12:40.688908 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.backup.rpcapi [None req-7910e2b1-4598-4d82-ae1f-167fadadead9 tempest-VolumesBackupsV39Test-1989329621 None] continue_backup in rpcapi backup_id b32d972f-452a-4227-b7c1-c19209399a98 {{(pid=131780) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Oct 29 21:12:40.757370 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:12:40.779161 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Flow 'volume_create_manager' (063fdb0f-4efb-44c2-a1e5-bc5aad7426eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:40.795365 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d02478-2358-4dce-b75e-a12d857d22d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:40.824644 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d02478-2358-4dce-b75e-a12d857d22d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-756455683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=57434d0e-a43f-4442-8e68-7900c8259237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a2789446244c589351c0d306ed44d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:12:41Z,use_quota=True,user_id='f00c811597ab424484feb813fb22d530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:40.832141 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23d8820-6bcb-401b-91b4-3f0cb54c39f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:40.838137 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23d8820-6bcb-401b-91b4-3f0cb54c39f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:40.846903 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239a03c1-63cc-464f-ba45-64cda6c025a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:40.851625 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239a03c1-63cc-464f-ba45-64cda6c025a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57434d0e-a43f-4442-8e68-7900c8259237', 'volume_name': 'volume-57434d0e-a43f-4442-8e68-7900c8259237', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:40.860392 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82168f1d-9562-4c17-a41a-23ef2d21e6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:40.865673 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82168f1d-9562-4c17-a41a-23ef2d21e6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:40.871952 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddf7b78-168e-4b3f-9a3e-73a5f2a56a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:40.874119 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Volume 57434d0e-a43f-4442-8e68-7900c8259237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57434d0e-a43f-4442-8e68-7900c8259237', 'volume_size': 1}
Oct 29 21:12:40.874759 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] creating volume 'volume-57434d0e-a43f-4442-8e68-7900c8259237' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:12:40.875999 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:40.962847 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:12:40.963222 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:12:40.967402 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddf7b78-168e-4b3f-9a3e-73a5f2a56a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57434d0e-a43f-4442-8e68-7900c8259237', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:40.973003 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475fc35f-8565-4438-a37c-d2d8f951e8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:40.987432 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Volume volume-57434d0e-a43f-4442-8e68-7900c8259237 (57434d0e-a43f-4442-8e68-7900c8259237): created successfully
Oct 29 21:12:40.991098 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475fc35f-8565-4438-a37c-d2d8f951e8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:40.996587 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Flow 'volume_create_manager' (063fdb0f-4efb-44c2-a1e5-bc5aad7426eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:41.007012 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b8dbf0dd-af87-4832-987e-b6674d8d6cea tempest-VolumesActionsTest-726015298 None] Created volume successfully.
Oct 29 21:12:41.806513 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-2f81d38a-595f-475a-8752-d4851ecef55a tempest-VolumesActionsTest-726015298 None] Acquiring lock "cinder-57434d0e-a43f-4442-8e68-7900c8259237" by "attach_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:12:41.825592 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-2f81d38a-595f-475a-8752-d4851ecef55a tempest-VolumesActionsTest-726015298 None] Lock "cinder-57434d0e-a43f-4442-8e68-7900c8259237" acquired by "attach_volume" :: waited 0.019s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:12:41.948448 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-2f81d38a-595f-475a-8752-d4851ecef55a tempest-VolumesActionsTest-726015298 None] Attaching volume 57434d0e-a43f-4442-8e68-7900c8259237 to instance 4d260077-ebdd-42a1-bd73-a3737f9ea290 at mountpoint /dev/sdb on host None.
Oct 29 21:12:41.995587 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-2f81d38a-595f-475a-8752-d4851ecef55a tempest-VolumesActionsTest-726015298 None] Attach volume completed successfully.
Oct 29 21:12:42.002701 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-2f81d38a-595f-475a-8752-d4851ecef55a tempest-VolumesActionsTest-726015298 None] Lock "cinder-57434d0e-a43f-4442-8e68-7900c8259237" released by "attach_volume" :: held 0.177s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:12:42.756665 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a49c1092-7941-4f28-8864-7e4554391b59 tempest-VolumesActionsTest-2016618601 None] Terminate volume connection completed successfully.
Oct 29 21:12:42.781843 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a49c1092-7941-4f28-8864-7e4554391b59 tempest-VolumesActionsTest-2016618601 None] Acquiring lock "cinder-57434d0e-a43f-4442-8e68-7900c8259237-detach_volume" by "detach_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:12:42.792301 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a49c1092-7941-4f28-8864-7e4554391b59 tempest-VolumesActionsTest-2016618601 None] Lock "cinder-57434d0e-a43f-4442-8e68-7900c8259237-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:12:42.805753 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a49c1092-7941-4f28-8864-7e4554391b59 tempest-VolumesActionsTest-2016618601 None] Detaching volume 57434d0e-a43f-4442-8e68-7900c8259237 from instance 4d260077-ebdd-42a1-bd73-a3737f9ea290.
Oct 29 21:12:42.852524 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a49c1092-7941-4f28-8864-7e4554391b59 tempest-VolumesActionsTest-2016618601 None] Detach volume completed successfully.
Oct 29 21:12:42.863990 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a49c1092-7941-4f28-8864-7e4554391b59 tempest-VolumesActionsTest-2016618601 None] Lock "cinder-57434d0e-a43f-4442-8e68-7900c8259237-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:12:43.062245 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a5eb2c9b-720b-4e26-ad4b-65bcc516df2e tempest-VolumesActionsTest-726015298 None] Acquiring lock "cinder-57434d0e-a43f-4442-8e68-7900c8259237-detach_volume" by "detach_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:12:43.075075 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a5eb2c9b-720b-4e26-ad4b-65bcc516df2e tempest-VolumesActionsTest-726015298 None] Lock "cinder-57434d0e-a43f-4442-8e68-7900c8259237-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:12:43.075664 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a5eb2c9b-720b-4e26-ad4b-65bcc516df2e tempest-VolumesActionsTest-726015298 None] Volume detach called, but volume not attached.
Oct 29 21:12:43.093656 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a5eb2c9b-720b-4e26-ad4b-65bcc516df2e tempest-VolumesActionsTest-726015298 None] Lock "cinder-57434d0e-a43f-4442-8e68-7900c8259237-detach_volume" released by "detach_volume" :: held 0.018s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:12:48.679521 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:12:48.766304 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Flow 'volume_create_manager' (14fe3680-26be-44e9-b8b3-3ebf5694274d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:48.785765 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd40ad0-e082-4f80-812a-9c090cc695f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:48.822998 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd40ad0-e082-4f80-812a-9c090cc695f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1935342210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ed912d46-0591-447a-b534-68aec502a53b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a2789446244c589351c0d306ed44d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:12:49Z,use_quota=True,user_id='f00c811597ab424484feb813fb22d530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:48.833557 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99898f5f-08ef-4a25-98d5-20636aaa2dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:48.840352 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99898f5f-08ef-4a25-98d5-20636aaa2dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:48.852154 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37bcf67-ceb4-4e1b-b712-3616af32717d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:48.869512 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37bcf67-ceb4-4e1b-b712-3616af32717d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed912d46-0591-447a-b534-68aec502a53b', 'volume_name': 'volume-ed912d46-0591-447a-b534-68aec502a53b', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:48.881310 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a602c52-8162-49b7-90f6-897d37f64cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:48.899565 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a602c52-8162-49b7-90f6-897d37f64cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:48.910123 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41297d7c-02b7-4fbb-ad11-577b2d590132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:48.912213 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Volume ed912d46-0591-447a-b534-68aec502a53b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed912d46-0591-447a-b534-68aec502a53b', 'volume_size': 1}
Oct 29 21:12:48.912997 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] creating volume 'volume-ed912d46-0591-447a-b534-68aec502a53b' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:12:48.914049 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:49.056382 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:12:49.057010 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:12:49.065563 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41297d7c-02b7-4fbb-ad11-577b2d590132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed912d46-0591-447a-b534-68aec502a53b', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:49.072496 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18975d76-47cf-4ac4-b3fc-4e16eae74702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:49.088289 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Volume volume-ed912d46-0591-447a-b534-68aec502a53b (ed912d46-0591-447a-b534-68aec502a53b): created successfully
Oct 29 21:12:49.099550 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18975d76-47cf-4ac4-b3fc-4e16eae74702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:49.118394 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Flow 'volume_create_manager' (14fe3680-26be-44e9-b8b3-3ebf5694274d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:49.145096 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-c7965a86-7962-476f-afe6-069f585e1bfc tempest-VolumesActionsTest-726015298 None] Created volume successfully.
Oct 29 21:12:49.425036 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-7910e2b1-4598-4d82-ae1f-167fadadead9 tempest-VolumesBackupsV39Test-1989329621 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:12:50.030370 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-606f90d6-8720-452e-bc38-64a21889739c tempest-VolumesActionsTest-2016618601 None] Acquiring lock "cinder-ed912d46-0591-447a-b534-68aec502a53b-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:12:50.109361 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-0d3567c9-2bfc-4dad-858e-e4bf3c37494d req-483aab48-3c77-4e42-b4a7-6199145f605f tempest-AttachVolumeShelveTestJSON-1635390820 None] Terminate volume connection completed successfully.
Oct 29 21:12:50.109851 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-0d3567c9-2bfc-4dad-858e-e4bf3c37494d req-483aab48-3c77-4e42-b4a7-6199145f605f tempest-AttachVolumeShelveTestJSON-1635390820 None] Deleting attachment 8704d2f3-7957-47f2-9f46-1e6a660389a0. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:12:50.122420 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-606f90d6-8720-452e-bc38-64a21889739c tempest-VolumesActionsTest-2016618601 None] Lock "cinder-ed912d46-0591-447a-b534-68aec502a53b-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:12:50.213249 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-606f90d6-8720-452e-bc38-64a21889739c tempest-VolumesActionsTest-2016618601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:50.341100 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-606f90d6-8720-452e-bc38-64a21889739c tempest-VolumesActionsTest-2016618601 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:12:50.341913 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-606f90d6-8720-452e-bc38-64a21889739c tempest-VolumesActionsTest-2016618601 None] Volume volume-ed912d46-0591-447a-b534-68aec502a53b is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:12:50.351972 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-606f90d6-8720-452e-bc38-64a21889739c tempest-VolumesActionsTest-2016618601 None] deleting rbd volume volume-ed912d46-0591-447a-b534-68aec502a53b {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:12:50.823192 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-606f90d6-8720-452e-bc38-64a21889739c tempest-VolumesActionsTest-2016618601 None] Created reservations ['09214232-867c-4813-b11e-e3deaa9bdfc6', 'e6e6132b-5590-44b7-80e9-143eae3972f5', 'b3cf15fe-dbb9-464a-a2ea-c8b93b41dde9', '428ac143-f85f-4c51-9b09-cae8539a3723'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:12:50.918575 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-606f90d6-8720-452e-bc38-64a21889739c tempest-VolumesActionsTest-2016618601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:51.001847 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-606f90d6-8720-452e-bc38-64a21889739c tempest-VolumesActionsTest-2016618601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:51.088783 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-606f90d6-8720-452e-bc38-64a21889739c tempest-VolumesActionsTest-2016618601 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:12:51.107586 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-606f90d6-8720-452e-bc38-64a21889739c tempest-VolumesActionsTest-2016618601 None] Deleted volume successfully.
Oct 29 21:12:51.130087 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-606f90d6-8720-452e-bc38-64a21889739c tempest-VolumesActionsTest-2016618601 None] Lock "cinder-ed912d46-0591-447a-b534-68aec502a53b-delete_volume" released by "delete_volume" :: held 1.008s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:12:51.272020 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-7910e2b1-4598-4d82-ae1f-167fadadead9 tempest-VolumesBackupsV39Test-1989329621 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.847s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:12:51.272659 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7910e2b1-4598-4d82-ae1f-167fadadead9 tempest-VolumesBackupsV39Test-1989329621 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ba439e29-d4ab-4496-8288-3803f6f7dc81', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'ba439e29-d4ab-4496-8288-3803f6f7dc81', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:12:51.300499 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7910e2b1-4598-4d82-ae1f-167fadadead9 tempest-VolumesBackupsV39Test-1989329621 None] Initialize volume connection completed successfully.
Oct 29 21:12:51.878714 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:12:51.906693 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Flow 'volume_create_manager' (a85fec78-58bb-417d-944b-ad9c52c3aa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:51.913995 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8773283f-b19c-4880-adc4-525a2c8b6b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:51.936990 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8773283f-b19c-4880-adc4-525a2c8b6b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-126009479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bad52941-8a03-40ba-b195-8ea5cac44bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a2789446244c589351c0d306ed44d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:12:52Z,use_quota=True,user_id='f00c811597ab424484feb813fb22d530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:51.944161 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac67291-d578-468e-a609-265acdffb5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:51.949742 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac67291-d578-468e-a609-265acdffb5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:51.955242 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9c72bc-5a72-485b-b72b-7e1e357ea251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:51.960125 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9c72bc-5a72-485b-b72b-7e1e357ea251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bad52941-8a03-40ba-b195-8ea5cac44bdc', 'volume_name': 'volume-bad52941-8a03-40ba-b195-8ea5cac44bdc', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:51.965932 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab2933d-1aca-464e-a8aa-100acd664afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:51.970705 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab2933d-1aca-464e-a8aa-100acd664afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:51.975602 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b828af-e2a0-4179-896b-83acd9b3b85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:51.976709 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Volume bad52941-8a03-40ba-b195-8ea5cac44bdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bad52941-8a03-40ba-b195-8ea5cac44bdc', 'volume_size': 1}
Oct 29 21:12:51.977113 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] creating volume 'volume-bad52941-8a03-40ba-b195-8ea5cac44bdc' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:12:51.977978 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:52.110837 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:12:52.111761 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:12:52.115315 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b828af-e2a0-4179-896b-83acd9b3b85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bad52941-8a03-40ba-b195-8ea5cac44bdc', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:52.125154 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23421857-955d-4d6d-a124-eee787879d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:52.148255 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Volume volume-bad52941-8a03-40ba-b195-8ea5cac44bdc (bad52941-8a03-40ba-b195-8ea5cac44bdc): created successfully
Oct 29 21:12:52.155666 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23421857-955d-4d6d-a124-eee787879d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:52.166620 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Flow 'volume_create_manager' (a85fec78-58bb-417d-944b-ad9c52c3aa7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:52.201917 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-91ea4e89-c033-4c34-835a-7f48e3b3a2ec tempest-VolumesActionsTest-726015298 None] Created volume successfully.
Oct 29 21:12:53.213418 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-fcacfefd-f853-4017-b041-6cd482fb1953 tempest-VolumesActionsTest-2016618601 None] Acquiring lock "cinder-bad52941-8a03-40ba-b195-8ea5cac44bdc-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:12:53.232578 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-fcacfefd-f853-4017-b041-6cd482fb1953 tempest-VolumesActionsTest-2016618601 None] Lock "cinder-bad52941-8a03-40ba-b195-8ea5cac44bdc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:12:53.314418 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fcacfefd-f853-4017-b041-6cd482fb1953 tempest-VolumesActionsTest-2016618601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:53.446204 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fcacfefd-f853-4017-b041-6cd482fb1953 tempest-VolumesActionsTest-2016618601 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:12:53.446715 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fcacfefd-f853-4017-b041-6cd482fb1953 tempest-VolumesActionsTest-2016618601 None] Volume volume-bad52941-8a03-40ba-b195-8ea5cac44bdc is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:12:53.468378 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fcacfefd-f853-4017-b041-6cd482fb1953 tempest-VolumesActionsTest-2016618601 None] deleting rbd volume volume-bad52941-8a03-40ba-b195-8ea5cac44bdc {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:12:53.833311 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-fcacfefd-f853-4017-b041-6cd482fb1953 tempest-VolumesActionsTest-2016618601 None] Created reservations ['f404b83b-cbea-4165-99e8-42529477997d', '41d385ea-7c26-4e4c-bca0-eec5dbd5ee14', 'cf165dad-7a4d-45ef-8e86-c7cd7e3c5bdc', '601f6d1a-94a7-4926-850d-880bd9076e71'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:12:53.897872 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=62,cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:12:53.936648 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fcacfefd-f853-4017-b041-6cd482fb1953 tempest-VolumesActionsTest-2016618601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:54.029589 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fcacfefd-f853-4017-b041-6cd482fb1953 tempest-VolumesActionsTest-2016618601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:54.115793 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-fcacfefd-f853-4017-b041-6cd482fb1953 tempest-VolumesActionsTest-2016618601 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:12:54.121428 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-fcacfefd-f853-4017-b041-6cd482fb1953 tempest-VolumesActionsTest-2016618601 None] Deleted volume successfully.
Oct 29 21:12:54.149211 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-fcacfefd-f853-4017-b041-6cd482fb1953 tempest-VolumesActionsTest-2016618601 None] Lock "cinder-bad52941-8a03-40ba-b195-8ea5cac44bdc-delete_volume" released by "delete_volume" :: held 0.917s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:12:55.313812 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7910e2b1-4598-4d82-ae1f-167fadadead9 tempest-VolumesBackupsV39Test-1989329621 None] Terminate volume connection completed successfully.
Oct 29 21:12:55.375180 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7910e2b1-4598-4d82-ae1f-167fadadead9 tempest-VolumesBackupsV39Test-1989329621 None] Remove volume export completed successfully.
Oct 29 21:12:55.403487 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:12:55.451114 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Flow 'volume_create_manager' (b296b12b-a3cb-4255-a228-ba41f736711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:55.458882 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b50cc16-3bff-4551-984c-f4242d9b8025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:55.482837 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b50cc16-3bff-4551-984c-f4242d9b8025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1587014930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=169af861-21db-4caf-b890-919739c25bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a2789446244c589351c0d306ed44d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:12:55Z,use_quota=True,user_id='f00c811597ab424484feb813fb22d530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:55.489396 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef0d7ba-e6df-4383-bc08-6f700ee3c5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:55.493692 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef0d7ba-e6df-4383-bc08-6f700ee3c5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:55.499472 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a339da5-eefe-4d9f-bc1e-66d37359875d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:55.503792 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a339da5-eefe-4d9f-bc1e-66d37359875d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '169af861-21db-4caf-b890-919739c25bf5', 'volume_name': 'volume-169af861-21db-4caf-b890-919739c25bf5', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:55.518146 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3055593c-35e0-446e-9c17-25fafcc47373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:55.539527 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3055593c-35e0-446e-9c17-25fafcc47373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:55.567093 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0a5975-211c-4bf5-9c06-7764392c306b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:55.572520 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Volume 169af861-21db-4caf-b890-919739c25bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-169af861-21db-4caf-b890-919739c25bf5', 'volume_size': 1}
Oct 29 21:12:55.575100 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] creating volume 'volume-169af861-21db-4caf-b890-919739c25bf5' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:12:55.576263 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:55.723905 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:12:55.725219 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:12:55.735178 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0a5975-211c-4bf5-9c06-7764392c306b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-169af861-21db-4caf-b890-919739c25bf5', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:55.741576 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a958d6-7155-440e-857d-884b48580aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:55.759215 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Volume volume-169af861-21db-4caf-b890-919739c25bf5 (169af861-21db-4caf-b890-919739c25bf5): created successfully
Oct 29 21:12:55.766764 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a958d6-7155-440e-857d-884b48580aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:55.779441 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Flow 'volume_create_manager' (b296b12b-a3cb-4255-a228-ba41f736711c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:55.808083 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-abc0349d-864f-4a6e-af2d-8e34784675c4 tempest-VolumesActionsTest-726015298 None] Created volume successfully.
Oct 29 21:12:56.631710 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9bec6c4c-267a-446c-9a1c-55f1ae07b0bf tempest-VolumesActionsTest-2016618601 None] Acquiring lock "cinder-169af861-21db-4caf-b890-919739c25bf5-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:12:56.658358 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9bec6c4c-267a-446c-9a1c-55f1ae07b0bf tempest-VolumesActionsTest-2016618601 None] Lock "cinder-169af861-21db-4caf-b890-919739c25bf5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:12:56.665686 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=67,cinder:UPDATE=26,cinder:DELETE=4,cinder:INSERT=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:12:56.736679 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9bec6c4c-267a-446c-9a1c-55f1ae07b0bf tempest-VolumesActionsTest-2016618601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:56.867940 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9bec6c4c-267a-446c-9a1c-55f1ae07b0bf tempest-VolumesActionsTest-2016618601 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:12:56.868524 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9bec6c4c-267a-446c-9a1c-55f1ae07b0bf tempest-VolumesActionsTest-2016618601 None] Volume volume-169af861-21db-4caf-b890-919739c25bf5 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:12:56.875316 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9bec6c4c-267a-446c-9a1c-55f1ae07b0bf tempest-VolumesActionsTest-2016618601 None] deleting rbd volume volume-169af861-21db-4caf-b890-919739c25bf5 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:12:57.265700 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-9bec6c4c-267a-446c-9a1c-55f1ae07b0bf tempest-VolumesActionsTest-2016618601 None] Created reservations ['0c2b2eed-1abe-4dcf-9db3-1d876dbcadca', '8647c42c-734c-4ef1-8905-cdae6d456e08', '0bb18480-3e13-4b03-a6c7-95dba7cca32a', 'c7420638-59b4-4fc8-a989-7ed649eceef0'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:12:57.388469 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9bec6c4c-267a-446c-9a1c-55f1ae07b0bf tempest-VolumesActionsTest-2016618601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:57.453072 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9bec6c4c-267a-446c-9a1c-55f1ae07b0bf tempest-VolumesActionsTest-2016618601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:57.525664 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-9bec6c4c-267a-446c-9a1c-55f1ae07b0bf tempest-VolumesActionsTest-2016618601 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:12:57.531461 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-9bec6c4c-267a-446c-9a1c-55f1ae07b0bf tempest-VolumesActionsTest-2016618601 None] Deleted volume successfully.
Oct 29 21:12:57.551568 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9bec6c4c-267a-446c-9a1c-55f1ae07b0bf tempest-VolumesActionsTest-2016618601 None] Lock "cinder-169af861-21db-4caf-b890-919739c25bf5-delete_volume" released by "delete_volume" :: held 0.893s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:12:57.898844 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-459facf4-c4e0-4eb3-ad96-f22b2993a8ac tempest-VolumesBackupsV39Test-1989329621 None] Acquiring lock "cinder-ba439e29-d4ab-4496-8288-3803f6f7dc81-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:12:57.915587 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-459facf4-c4e0-4eb3-ad96-f22b2993a8ac tempest-VolumesBackupsV39Test-1989329621 None] Lock "cinder-ba439e29-d4ab-4496-8288-3803f6f7dc81-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:12:57.976992 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-459facf4-c4e0-4eb3-ad96-f22b2993a8ac tempest-VolumesBackupsV39Test-1989329621 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:59.043532 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-459facf4-c4e0-4eb3-ad96-f22b2993a8ac tempest-VolumesBackupsV39Test-1989329621 None] Volume volume-ba439e29-d4ab-4496-8288-3803f6f7dc81 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:12:59.076265 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-459facf4-c4e0-4eb3-ad96-f22b2993a8ac tempest-VolumesBackupsV39Test-1989329621 None] deleting rbd volume volume-ba439e29-d4ab-4496-8288-3803f6f7dc81 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:12:59.122620 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:12:59.177086 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Flow 'volume_create_manager' (347b06ab-07d1-4e49-b1f8-1e1af1aab405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:59.203914 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd48621e-2db4-4004-aa8d-c8ab453277c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:59.279412 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd48621e-2db4-4004-aa8d-c8ab453277c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-467172904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cb2a3f8c-30ca-4341-b019-7bd0705a8707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a2789446244c589351c0d306ed44d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:12:58Z,use_quota=True,user_id='f00c811597ab424484feb813fb22d530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:59.288116 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ba4244-caaf-4428-97c2-ca48b54fb1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:59.293068 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ba4244-caaf-4428-97c2-ca48b54fb1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:59.304959 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4161560-f6ad-4443-a101-30ddd59267c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:59.320131 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4161560-f6ad-4443-a101-30ddd59267c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb2a3f8c-30ca-4341-b019-7bd0705a8707', 'volume_name': 'volume-cb2a3f8c-30ca-4341-b019-7bd0705a8707', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:59.325162 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4bf46b-ef7d-4b26-84de-781149f3a0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:59.338151 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4bf46b-ef7d-4b26-84de-781149f3a0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:59.388887 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc34abe8-f93b-4ad2-9b85-a42f55288ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:59.389588 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Volume cb2a3f8c-30ca-4341-b019-7bd0705a8707: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb2a3f8c-30ca-4341-b019-7bd0705a8707', 'volume_size': 1}
Oct 29 21:12:59.389998 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] creating volume 'volume-cb2a3f8c-30ca-4341-b019-7bd0705a8707' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:12:59.392600 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:59.563366 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:12:59.564261 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:12:59.568733 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc34abe8-f93b-4ad2-9b85-a42f55288ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2a3f8c-30ca-4341-b019-7bd0705a8707', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:59.574244 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e987742-bde7-409d-b798-c6b56a6a7818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:12:59.608191 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Volume volume-cb2a3f8c-30ca-4341-b019-7bd0705a8707 (cb2a3f8c-30ca-4341-b019-7bd0705a8707): created successfully
Oct 29 21:12:59.616949 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e987742-bde7-409d-b798-c6b56a6a7818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:12:59.626663 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Flow 'volume_create_manager' (347b06ab-07d1-4e49-b1f8-1e1af1aab405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:12:59.652789 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a438bf7e-03ba-4dd8-b335-5c4d4e87b6bd tempest-VolumesActionsTest-726015298 None] Created volume successfully.
Oct 29 21:12:59.657362 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-459facf4-c4e0-4eb3-ad96-f22b2993a8ac tempest-VolumesBackupsV39Test-1989329621 None] Created reservations ['d2571e8e-ba5c-4e61-8068-3e6c2bdba1b4', 'a23345d1-5935-475e-8648-d277c444414c', '5e9ca23e-6f27-4296-9ffc-6f7e784ef299', '744294fd-4970-4037-8eee-f415cdc530e6'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:12:59.777483 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-459facf4-c4e0-4eb3-ad96-f22b2993a8ac tempest-VolumesBackupsV39Test-1989329621 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:59.846639 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-459facf4-c4e0-4eb3-ad96-f22b2993a8ac tempest-VolumesBackupsV39Test-1989329621 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:12:59.912487 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-459facf4-c4e0-4eb3-ad96-f22b2993a8ac tempest-VolumesBackupsV39Test-1989329621 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:12:59.924439 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-459facf4-c4e0-4eb3-ad96-f22b2993a8ac tempest-VolumesBackupsV39Test-1989329621 None] Deleted volume successfully.
Oct 29 21:12:59.960701 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-459facf4-c4e0-4eb3-ad96-f22b2993a8ac tempest-VolumesBackupsV39Test-1989329621 None] Lock "cinder-ba439e29-d4ab-4496-8288-3803f6f7dc81-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:13:00.992282 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-3957d25e-83ed-407d-871b-f3e2d2b9152b tempest-VolumesActionsTest-2016618601 None] Acquiring lock "cinder-cb2a3f8c-30ca-4341-b019-7bd0705a8707-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:13:01.008517 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-3957d25e-83ed-407d-871b-f3e2d2b9152b tempest-VolumesActionsTest-2016618601 None] Lock "cinder-cb2a3f8c-30ca-4341-b019-7bd0705a8707-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:13:01.104040 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3957d25e-83ed-407d-871b-f3e2d2b9152b tempest-VolumesActionsTest-2016618601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:01.225997 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3957d25e-83ed-407d-871b-f3e2d2b9152b tempest-VolumesActionsTest-2016618601 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:13:01.226593 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3957d25e-83ed-407d-871b-f3e2d2b9152b tempest-VolumesActionsTest-2016618601 None] Volume volume-cb2a3f8c-30ca-4341-b019-7bd0705a8707 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:13:01.242004 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3957d25e-83ed-407d-871b-f3e2d2b9152b tempest-VolumesActionsTest-2016618601 None] deleting rbd volume volume-cb2a3f8c-30ca-4341-b019-7bd0705a8707 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:13:01.390682 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:13:01.391474 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:01.478930 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:01.553139 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:13:01.664241 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-3957d25e-83ed-407d-871b-f3e2d2b9152b tempest-VolumesActionsTest-2016618601 None] Created reservations ['7be60084-5f48-4266-9528-a9db07b58228', '8f753146-9406-4668-aa72-06969f2b37cd', 'cb6c5242-07ef-4811-a438-722929e80e33', '24f186c4-8759-43f8-bc8b-7701ae55f5e7'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:13:01.770148 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3957d25e-83ed-407d-871b-f3e2d2b9152b tempest-VolumesActionsTest-2016618601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:01.862668 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3957d25e-83ed-407d-871b-f3e2d2b9152b tempest-VolumesActionsTest-2016618601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:01.929881 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-3957d25e-83ed-407d-871b-f3e2d2b9152b tempest-VolumesActionsTest-2016618601 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:13:01.947619 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-3957d25e-83ed-407d-871b-f3e2d2b9152b tempest-VolumesActionsTest-2016618601 None] Deleted volume successfully.
Oct 29 21:13:01.968682 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-3957d25e-83ed-407d-871b-f3e2d2b9152b tempest-VolumesActionsTest-2016618601 None] Lock "cinder-cb2a3f8c-30ca-4341-b019-7bd0705a8707-delete_volume" released by "delete_volume" :: held 0.960s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:13:03.242502 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:13:03.287310 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Flow 'volume_create_manager' (a302d563-f306-4e6d-a2c5-11fa009c5a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:13:03.348335 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20b81b7-a354-457e-8f37-e2a287c498a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:03.418380 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20b81b7-a354-457e-8f37-e2a287c498a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-410142746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=14bd66fa-fa9c-484b-854a-e3a0918eff29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0a2789446244c589351c0d306ed44d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:13:03Z,use_quota=True,user_id='f00c811597ab424484feb813fb22d530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:03.457620 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad04454-905b-4089-b74d-0702956c46b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:03.474082 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ad04454-905b-4089-b74d-0702956c46b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:03.481591 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af16596b-a335-4ab6-96b8-f310885e01b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:03.487905 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af16596b-a335-4ab6-96b8-f310885e01b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14bd66fa-fa9c-484b-854a-e3a0918eff29', 'volume_name': 'volume-14bd66fa-fa9c-484b-854a-e3a0918eff29', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:03.496074 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffecba3c-37d7-42d5-bfb8-c80940497e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:03.502480 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffecba3c-37d7-42d5-bfb8-c80940497e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:03.508594 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db94d2af-4359-45f0-a66e-f0badecf9946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:03.511946 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Volume 14bd66fa-fa9c-484b-854a-e3a0918eff29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14bd66fa-fa9c-484b-854a-e3a0918eff29', 'volume_size': 1}
Oct 29 21:13:03.512550 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] creating volume 'volume-14bd66fa-fa9c-484b-854a-e3a0918eff29' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:13:03.514109 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:03.624288 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:13:03.652255 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Flow 'volume_create_manager' (919314aa-c05e-4d3f-b0c0-5af113a45793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:13:03.662601 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9141240-fa25-4478-926b-56ef1dae61ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:03.709932 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:13:03.710560 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:13:03.722973 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db94d2af-4359-45f0-a66e-f0badecf9946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14bd66fa-fa9c-484b-854a-e3a0918eff29', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:03.736336 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c279403d-4a78-4f1d-8cb0-c0017d8bf83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:03.764663 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9141240-fa25-4478-926b-56ef1dae61ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-762257797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=93c37ec6-3084-4796-8e73-96d84a9ea40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbee029e55124f2bb37672fbee64a42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:13:03Z,use_quota=True,user_id='f21c99f8530a41439b59b8dbaf2369dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:03.781017 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e299bc-5d01-427c-8695-2d1f13fbe29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:03.796802 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e299bc-5d01-427c-8695-2d1f13fbe29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:03.812532 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c16f69f-b0a2-42db-8a65-898a7a0875a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:03.827790 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c16f69f-b0a2-42db-8a65-898a7a0875a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93c37ec6-3084-4796-8e73-96d84a9ea40a', 'volume_name': 'volume-93c37ec6-3084-4796-8e73-96d84a9ea40a', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:03.835134 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f157aa94-b3da-46ae-83bf-8cb441e0dd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:03.840132 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f157aa94-b3da-46ae-83bf-8cb441e0dd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:03.845396 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89375e12-7787-4d3d-ac0b-36435fcfb5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:03.847270 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Volume 93c37ec6-3084-4796-8e73-96d84a9ea40a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93c37ec6-3084-4796-8e73-96d84a9ea40a', 'volume_size': 1}
Oct 29 21:13:03.847675 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] creating volume 'volume-93c37ec6-3084-4796-8e73-96d84a9ea40a' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:13:03.848467 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:03.885181 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Volume volume-14bd66fa-fa9c-484b-854a-e3a0918eff29 (14bd66fa-fa9c-484b-854a-e3a0918eff29): created successfully
Oct 29 21:13:03.889263 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c279403d-4a78-4f1d-8cb0-c0017d8bf83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:03.906488 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Flow 'volume_create_manager' (a302d563-f306-4e6d-a2c5-11fa009c5a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:13:03.928167 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-77a972dd-42ca-48d3-96c1-e336f04d6be3 tempest-VolumesActionsTest-726015298 None] Created volume successfully.
Oct 29 21:13:03.951394 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:13:03.952261 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:13:03.957350 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89375e12-7787-4d3d-ac0b-36435fcfb5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c37ec6-3084-4796-8e73-96d84a9ea40a', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:03.963676 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de50828-a86c-42c0-b5e0-8920fa851c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:03.980812 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Volume volume-93c37ec6-3084-4796-8e73-96d84a9ea40a (93c37ec6-3084-4796-8e73-96d84a9ea40a): created successfully
Oct 29 21:13:03.989228 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de50828-a86c-42c0-b5e0-8920fa851c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:04.005214 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Flow 'volume_create_manager' (919314aa-c05e-4d3f-b0c0-5af113a45793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:13:04.017792 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-358342c1-484c-42c7-82f4-7e8fd53d6e14 tempest-AttachVolumeNegativeTest-2104062597 None] Created volume successfully.
Oct 29 21:13:05.288153 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-6bdee36d-edca-4393-b4d4-c5d713ce13b7 tempest-VolumesActionsTest-726015298 None] Acquiring lock "cinder-14bd66fa-fa9c-484b-854a-e3a0918eff29-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:13:05.303776 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-6bdee36d-edca-4393-b4d4-c5d713ce13b7 tempest-VolumesActionsTest-726015298 None] Lock "cinder-14bd66fa-fa9c-484b-854a-e3a0918eff29-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:13:05.305932 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=56,cinder:DELETE=3,cinder:UPDATE=36,cinder:INSERT=5 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:13:05.401870 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6bdee36d-edca-4393-b4d4-c5d713ce13b7 tempest-VolumesActionsTest-726015298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:05.471314 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6bdee36d-edca-4393-b4d4-c5d713ce13b7 tempest-VolumesActionsTest-726015298 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:13:05.471935 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6bdee36d-edca-4393-b4d4-c5d713ce13b7 tempest-VolumesActionsTest-726015298 None] Volume volume-14bd66fa-fa9c-484b-854a-e3a0918eff29 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:13:05.486229 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6bdee36d-edca-4393-b4d4-c5d713ce13b7 tempest-VolumesActionsTest-726015298 None] deleting rbd volume volume-14bd66fa-fa9c-484b-854a-e3a0918eff29 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:13:05.853712 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-de8e3752-f0bc-486d-a1a6-064406f8ad0a req-acfca480-01c1-4899-8bbf-ac18a9f599a2 tempest-AttachVolumeNegativeTest-2104062597 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:13:06.032343 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-6bdee36d-edca-4393-b4d4-c5d713ce13b7 tempest-VolumesActionsTest-726015298 None] Created reservations ['e6d0454c-d3e8-4e19-bd48-dd5586f81a4f', '6313f092-09b6-4728-abc4-33161d9975d3', '514f89d4-0b69-4b0b-b8c7-82ffe86ac069', '2093dee1-e360-44bc-a088-db4aa764eca1'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:13:06.073895 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=60,cinder:INSERT=9,cinder:UPDATE=27,cinder:DELETE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:13:06.160474 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6bdee36d-edca-4393-b4d4-c5d713ce13b7 tempest-VolumesActionsTest-726015298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:06.218522 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6bdee36d-edca-4393-b4d4-c5d713ce13b7 tempest-VolumesActionsTest-726015298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:06.279590 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-6bdee36d-edca-4393-b4d4-c5d713ce13b7 tempest-VolumesActionsTest-726015298 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:13:06.285285 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-6bdee36d-edca-4393-b4d4-c5d713ce13b7 tempest-VolumesActionsTest-726015298 None] Deleted volume successfully.
Oct 29 21:13:06.300378 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-6bdee36d-edca-4393-b4d4-c5d713ce13b7 tempest-VolumesActionsTest-726015298 None] Lock "cinder-14bd66fa-fa9c-484b-854a-e3a0918eff29-delete_volume" released by "delete_volume" :: held 0.997s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:13:07.440769 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:13:07.533831 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Flow 'volume_create_manager' (39c8a5d6-7c4a-4a3c-a2cf-088cbb71eb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:13:07.560377 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc4e033-7fbd-4ef8-b912-f4e115bb3b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:07.651253 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc4e033-7fbd-4ef8-b912-f4e115bb3b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-696868045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bde4424f-a811-49fc-b4f0-5d5fc9767766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10601894adb44985b208c3ab7ffa22c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:13:07Z,use_quota=True,user_id='04bbe6295ba34150b3609466e42c8abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:07.700571 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b32f717-e147-4da6-9c48-89143a503811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:07.731679 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b32f717-e147-4da6-9c48-89143a503811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:07.758475 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2562be-c0c2-433d-9ac1-5f31081595c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:07.770928 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2562be-c0c2-433d-9ac1-5f31081595c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde4424f-a811-49fc-b4f0-5d5fc9767766', 'volume_name': 'volume-bde4424f-a811-49fc-b4f0-5d5fc9767766', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:07.797260 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce669cfa-165f-44a1-b714-694d62eba17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:07.815725 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce669cfa-165f-44a1-b714-694d62eba17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:07.837827 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6673d881-11b1-4795-947a-a0d4e8dccf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:07.851103 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Volume bde4424f-a811-49fc-b4f0-5d5fc9767766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde4424f-a811-49fc-b4f0-5d5fc9767766', 'volume_size': 1}
Oct 29 21:13:07.851513 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] creating volume 'volume-bde4424f-a811-49fc-b4f0-5d5fc9767766' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:13:07.857859 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:07.982860 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b14609ab-5d75-46ee-8630-edb4d0e8ebca tempest-VolumesActionsTest-726015298 None] Acquiring lock "cinder-57434d0e-a43f-4442-8e68-7900c8259237-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:13:07.985806 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-de8e3752-f0bc-486d-a1a6-064406f8ad0a req-acfca480-01c1-4899-8bbf-ac18a9f599a2 tempest-AttachVolumeNegativeTest-2104062597 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.132s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:13:07.993633 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-de8e3752-f0bc-486d-a1a6-064406f8ad0a req-acfca480-01c1-4899-8bbf-ac18a9f599a2 tempest-AttachVolumeNegativeTest-2104062597 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-93c37ec6-3084-4796-8e73-96d84a9ea40a', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '93c37ec6-3084-4796-8e73-96d84a9ea40a', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:13:08.054890 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b14609ab-5d75-46ee-8630-edb4d0e8ebca tempest-VolumesActionsTest-726015298 None] Lock "cinder-57434d0e-a43f-4442-8e68-7900c8259237-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:13:08.083412 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:13:08.084054 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:13:08.099156 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6673d881-11b1-4795-947a-a0d4e8dccf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde4424f-a811-49fc-b4f0-5d5fc9767766', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:08.122456 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81301700-db47-4c6a-bf44-8e5b2b6a55b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:08.168158 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Volume volume-bde4424f-a811-49fc-b4f0-5d5fc9767766 (bde4424f-a811-49fc-b4f0-5d5fc9767766): created successfully
Oct 29 21:13:08.172563 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81301700-db47-4c6a-bf44-8e5b2b6a55b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:08.190714 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Flow 'volume_create_manager' (39c8a5d6-7c4a-4a3c-a2cf-088cbb71eb08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:13:08.213208 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-de8e3752-f0bc-486d-a1a6-064406f8ad0a req-acfca480-01c1-4899-8bbf-ac18a9f599a2 tempest-AttachVolumeNegativeTest-2104062597 None] Connection info returned from driver {'name': 'volumes/volume-93c37ec6-3084-4796-8e73-96d84a9ea40a', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '93c37ec6-3084-4796-8e73-96d84a9ea40a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c6690b19-3f86-4187-80a3-dda0ebfaa0d0'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:13:08.226237 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-d75eecaf-30ec-4b11-8a07-145a84ea0882 tempest-VolumesSnapshotTestJSON-1969201650 None] Created volume successfully.
Oct 29 21:13:08.348671 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b14609ab-5d75-46ee-8630-edb4d0e8ebca tempest-VolumesActionsTest-726015298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:08.462808 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b14609ab-5d75-46ee-8630-edb4d0e8ebca tempest-VolumesActionsTest-726015298 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:13:08.463398 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b14609ab-5d75-46ee-8630-edb4d0e8ebca tempest-VolumesActionsTest-726015298 None] Volume volume-57434d0e-a43f-4442-8e68-7900c8259237 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:13:08.474049 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b14609ab-5d75-46ee-8630-edb4d0e8ebca tempest-VolumesActionsTest-726015298 None] deleting rbd volume volume-57434d0e-a43f-4442-8e68-7900c8259237 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:13:08.611657 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-de8e3752-f0bc-486d-a1a6-064406f8ad0a req-acfca480-01c1-4899-8bbf-ac18a9f599a2 tempest-AttachVolumeNegativeTest-2104062597 None] attachment_update completed successfully.
Oct 29 21:13:09.002838 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-b14609ab-5d75-46ee-8630-edb4d0e8ebca tempest-VolumesActionsTest-726015298 None] Created reservations ['87b4cc58-7215-4a51-8756-46fac01c0c8c', 'dc7f6c3d-bf59-410b-ad64-05ef9e863c75', '7ae763b3-e70d-45d3-a7b7-4d10db1a2d89', '9016a3b9-33d0-46fb-951f-f8ea18945945'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:13:09.176541 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b14609ab-5d75-46ee-8630-edb4d0e8ebca tempest-VolumesActionsTest-726015298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:09.302464 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b14609ab-5d75-46ee-8630-edb4d0e8ebca tempest-VolumesActionsTest-726015298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:09.452306 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-b14609ab-5d75-46ee-8630-edb4d0e8ebca tempest-VolumesActionsTest-726015298 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:13:09.458108 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b14609ab-5d75-46ee-8630-edb4d0e8ebca tempest-VolumesActionsTest-726015298 None] Deleted volume successfully.
Oct 29 21:13:09.519637 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-28517032-43e1-4765-a5f7-984e5c152573 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:09.616135 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b14609ab-5d75-46ee-8630-edb4d0e8ebca tempest-VolumesActionsTest-726015298 None] Lock "cinder-57434d0e-a43f-4442-8e68-7900c8259237-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:13:09.944282 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-28517032-43e1-4765-a5f7-984e5c152573 tempest-VolumesSnapshotTestJSON-1969201650 None] Create snapshot completed successfully
Oct 29 21:13:10.959906 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.driver [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Creating a new backup for volume volume-bde4424f-a811-49fc-b4f0-5d5fc9767766. {{(pid=131780) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1218}}
Oct 29 21:13:11.025249 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] cloning volumes/volume-bde4424f-a811-49fc-b4f0-5d5fc9767766@snapshot-5740aba7-0776-4cc8-befc-d09a9077ebb7 to volume-5359fadf-678d-4a7d-84d7-1d086f725060 {{(pid=131780) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}}
Oct 29 21:13:11.031799 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:11.131325 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:11.335101 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:13:11.335828 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:13:11.344099 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:11.434342 ncdv-master-1 cinder-volume[131780]: WARNING cinder.volume.drivers.rbd [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues
Oct 29 21:13:11.473206 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-29T21:13:10Z,data_timestamp=2022-10-29T21:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-1015289325',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=54dd79e5-0dfa-4511-b5ab-018be59ec470,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='10601894adb44985b208c3ab7ffa22c8',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='5740aba7-0776-4cc8-befc-d09a9077ebb7',status='creating',temp_snapshot_id=None,temp_volume_id='5359fadf-678d-4a7d-84d7-1d086f725060',updated_at=None,user_id='04bbe6295ba34150b3609466e42c8abd',volume_id=bde4424f-a811-49fc-b4f0-5d5fc9767766)
Oct 29 21:13:11.475215 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.backup.rpcapi [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] continue_backup in rpcapi backup_id 54dd79e5-0dfa-4511-b5ab-018be59ec470 {{(pid=131780) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Oct 29 21:13:11.756380 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:13:12.871491 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.115s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:13:12.872458 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5359fadf-678d-4a7d-84d7-1d086f725060', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '5359fadf-678d-4a7d-84d7-1d086f725060', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:13:12.898912 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Initialize volume connection completed successfully.
Oct 29 21:13:26.945512 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:13:27.003352 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Flow 'volume_create_manager' (1cfc687f-6b26-46fd-b929-33aaca7ca05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:13:27.014888 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a437bb4f-de4b-4ae3-a9c2-ee23938d08e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:27.082083 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a437bb4f-de4b-4ae3-a9c2-ee23938d08e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1756181244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e3b04025-5a64-4c5a-b68a-e900266a1b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03dfceaf03b04a568a31f8a11306afa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:13:27Z,use_quota=True,user_id='ec705b2f6ff048c599731c513859a76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:27.097322 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf42a5e9-073a-4d31-bfca-a3f1ef5f887d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:27.104479 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf42a5e9-073a-4d31-bfca-a3f1ef5f887d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:27.144699 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9155664a-6bd5-4b9d-90a1-bd5da795288a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:27.187860 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9155664a-6bd5-4b9d-90a1-bd5da795288a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b04025-5a64-4c5a-b68a-e900266a1b1c', 'volume_name': 'volume-e3b04025-5a64-4c5a-b68a-e900266a1b1c', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:27.247512 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe3cdbe-c58a-4981-98bb-8e98bb0ef7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:27.256053 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe3cdbe-c58a-4981-98bb-8e98bb0ef7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:27.273320 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a995516-f0b7-4542-83b1-25df90f1c26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:27.275537 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Volume e3b04025-5a64-4c5a-b68a-e900266a1b1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b04025-5a64-4c5a-b68a-e900266a1b1c', 'volume_size': 1}
Oct 29 21:13:27.276616 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] creating volume 'volume-e3b04025-5a64-4c5a-b68a-e900266a1b1c' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:13:27.285163 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:27.556025 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:13:27.556807 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:13:27.562903 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a995516-f0b7-4542-83b1-25df90f1c26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b04025-5a64-4c5a-b68a-e900266a1b1c', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:27.578329 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd8adb3-84cd-4d6e-8775-53efe5c85de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:27.606128 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Volume volume-e3b04025-5a64-4c5a-b68a-e900266a1b1c (e3b04025-5a64-4c5a-b68a-e900266a1b1c): created successfully
Oct 29 21:13:27.610587 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd8adb3-84cd-4d6e-8775-53efe5c85de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:27.618620 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Flow 'volume_create_manager' (1cfc687f-6b26-46fd-b929-33aaca7ca05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:13:27.639929 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-8c137e2a-0dab-46fa-8f6d-5e569a09046e tempest-SnapshotMetadataTestJSON-1103040115 None] Created volume successfully.
Oct 29 21:13:28.529370 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c0343b8-ea91-4d46-8145-05fd5fa6313f tempest-SnapshotMetadataTestJSON-1103040115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:29.508330 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-8c0343b8-ea91-4d46-8145-05fd5fa6313f tempest-SnapshotMetadataTestJSON-1103040115 None] Create snapshot completed successfully
Oct 29 21:13:29.915376 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Terminate volume connection completed successfully.
Oct 29 21:13:29.964097 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Remove volume export completed successfully.
Oct 29 21:13:30.004103 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-5359fadf-678d-4a7d-84d7-1d086f725060-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:13:30.016965 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-5359fadf-678d-4a7d-84d7-1d086f725060-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:13:30.051973 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:30.162104 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:13:30.174698 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] deleting rbd volume volume-5359fadf-678d-4a7d-84d7-1d086f725060 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:13:30.588167 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=63,cinder:INSERT=7,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:13:30.705124 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Deleted volume successfully.
Oct 29 21:13:30.719625 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-4773af7d-6827-4217-b806-d4ba2dd9e2b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-5359fadf-678d-4a7d-84d7-1d086f725060-delete_volume" released by "delete_volume" :: held 0.702s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:13:31.903969 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-627ecfd1-9145-4eae-940e-9223c099954d tempest-SnapshotMetadataTestJSON-1103040115 None] Acquiring lock "cinder-d2e07525-68b9-4330-83c5-8a8feb7e630b-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:13:31.940451 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-627ecfd1-9145-4eae-940e-9223c099954d tempest-SnapshotMetadataTestJSON-1103040115 None] Lock "cinder-d2e07525-68b9-4330-83c5-8a8feb7e630b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:13:31.945017 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-627ecfd1-9145-4eae-940e-9223c099954d tempest-SnapshotMetadataTestJSON-1103040115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:33.167891 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-627ecfd1-9145-4eae-940e-9223c099954d tempest-SnapshotMetadataTestJSON-1103040115 None] Created reservations ['4fbc4925-f480-42e2-b88f-05e2f3bf94e2', '49a88d7f-ed17-49dd-95db-28d2c319872e', '9372c0ae-109e-4d04-8415-8aa7114860db', '35aa4421-4f43-4fcf-9b0a-d7a4d4b78f38'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:13:33.248005 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-627ecfd1-9145-4eae-940e-9223c099954d tempest-SnapshotMetadataTestJSON-1103040115 None] Delete snapshot completed successfully.
Oct 29 21:13:33.255474 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-627ecfd1-9145-4eae-940e-9223c099954d tempest-SnapshotMetadataTestJSON-1103040115 None] Lock "cinder-d2e07525-68b9-4330-83c5-8a8feb7e630b-delete_snapshot" released by "delete_snapshot" :: held 1.319s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:13:34.151363 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-2e8f3ae7-b34e-4884-a12b-46836512854f tempest-SnapshotMetadataTestJSON-1103040115 None] Acquiring lock "cinder-e3b04025-5a64-4c5a-b68a-e900266a1b1c-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:13:34.163944 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-2e8f3ae7-b34e-4884-a12b-46836512854f tempest-SnapshotMetadataTestJSON-1103040115 None] Lock "cinder-e3b04025-5a64-4c5a-b68a-e900266a1b1c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:13:34.263945 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=31,cinder:SELECT=63,cinder:DELETE=3,cinder:INSERT=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:13:34.283589 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2e8f3ae7-b34e-4884-a12b-46836512854f tempest-SnapshotMetadataTestJSON-1103040115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:34.396177 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2e8f3ae7-b34e-4884-a12b-46836512854f tempest-SnapshotMetadataTestJSON-1103040115 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:13:34.396752 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2e8f3ae7-b34e-4884-a12b-46836512854f tempest-SnapshotMetadataTestJSON-1103040115 None] Volume volume-e3b04025-5a64-4c5a-b68a-e900266a1b1c is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:13:34.410397 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2e8f3ae7-b34e-4884-a12b-46836512854f tempest-SnapshotMetadataTestJSON-1103040115 None] deleting rbd volume volume-e3b04025-5a64-4c5a-b68a-e900266a1b1c {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:13:34.880106 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-2e8f3ae7-b34e-4884-a12b-46836512854f tempest-SnapshotMetadataTestJSON-1103040115 None] Created reservations ['6983cfcf-dac6-4570-83ee-7451e59b5653', '3697e258-9233-4bea-a2b2-6a7f99a45087', '4a4ea4ef-ff36-4f9d-9662-c26bc612b016', '3a213934-13d2-4336-9de3-a5e5934b7633'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:13:34.936097 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2e8f3ae7-b34e-4884-a12b-46836512854f tempest-SnapshotMetadataTestJSON-1103040115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:35.017379 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2e8f3ae7-b34e-4884-a12b-46836512854f tempest-SnapshotMetadataTestJSON-1103040115 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:35.088011 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-2e8f3ae7-b34e-4884-a12b-46836512854f tempest-SnapshotMetadataTestJSON-1103040115 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:13:35.096485 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-2e8f3ae7-b34e-4884-a12b-46836512854f tempest-SnapshotMetadataTestJSON-1103040115 None] Deleted volume successfully.
Oct 29 21:13:35.116183 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-2e8f3ae7-b34e-4884-a12b-46836512854f tempest-SnapshotMetadataTestJSON-1103040115 None] Lock "cinder-e3b04025-5a64-4c5a-b68a-e900266a1b1c-delete_volume" released by "delete_volume" :: held 0.952s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:13:42.139560 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:13:42.176731 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Flow 'volume_create_manager' (7c5873bd-d0a8-44de-aa63-e7d18406ad16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:13:42.185045 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079c4656-a50c-4378-b07e-96338d21806a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:42.217881 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079c4656-a50c-4378-b07e-96338d21806a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-134263889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f8dfedd5-1323-4000-a0b4-5133cbbddc98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4e07d8f2fd42b8938d275b1ae3f6cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:13:42Z,use_quota=True,user_id='377648e5f36c45b6a0a7b88189ce43a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:42.225761 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a0a257-67c2-42cd-88a4-82c450f67b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:42.232135 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21a0a257-67c2-42cd-88a4-82c450f67b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:42.238035 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d305d53-d82f-483a-920f-afe2ddfe8245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:42.398400 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d305d53-d82f-483a-920f-afe2ddfe8245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8dfedd5-1323-4000-a0b4-5133cbbddc98', 'volume_name': 'volume-f8dfedd5-1323-4000-a0b4-5133cbbddc98', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9346735610>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:42.407171 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d209fb5-963d-4983-9263-2fcc1a453287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:42.418114 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d209fb5-963d-4983-9263-2fcc1a453287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:42.427715 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ab5daf-f721-40c4-bc61-0e4e5c321157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:42.431714 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Volume f8dfedd5-1323-4000-a0b4-5133cbbddc98: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8dfedd5-1323-4000-a0b4-5133cbbddc98', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9346735610>}
Oct 29 21:13:42.432864 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Cloning f8dfedd5-1323-4000-a0b4-5133cbbddc98 from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 21:13:42.433661 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:13:42.454963 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.021s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:13:42.472336 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 13, 42, 461476)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:13:42.473119 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:13:42.473907 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Found cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 29 21:13:42.480558 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 0.025s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:13:42.481419 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 21:13:42.511640 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 13, 42, 490144)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:13:42.513204 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:13:42.513818 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Creating from source image-volume fbe0dd2e-351a-4779-844d-3c66baf14939 {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 29 21:13:42.548776 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:42.673824 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] creating snapshot='volume-f8dfedd5-1323-4000-a0b4-5133cbbddc98.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 21:13:43.037926 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] cloning 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939@volume-f8dfedd5-1323-4000-a0b4-5133cbbddc98.clone_snap' to 'volume-f8dfedd5-1323-4000-a0b4-5133cbbddc98' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 21:13:43.250824 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:13:43.252875 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:13:43.253442 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:13:43.293003 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 21:13:43.293775 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Marking volume f8dfedd5-1323-4000-a0b4-5133cbbddc98 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 21:13:43.306963 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to f8dfedd5-1323-4000-a0b4-5133cbbddc98. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 21:13:43.308764 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Creating volume glance metadata for volume f8dfedd5-1323-4000-a0b4-5133cbbddc98 backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 21:13:43.390777 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ab5daf-f721-40c4-bc61-0e4e5c321157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8dfedd5-1323-4000-a0b4-5133cbbddc98', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9346735610>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:43.397406 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983f3eff-8562-4e83-b21f-5f27c3330db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:43.409712 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Volume volume-f8dfedd5-1323-4000-a0b4-5133cbbddc98 (f8dfedd5-1323-4000-a0b4-5133cbbddc98): created successfully
Oct 29 21:13:43.415122 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983f3eff-8562-4e83-b21f-5f27c3330db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:43.425161 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Flow 'volume_create_manager' (7c5873bd-d0a8-44de-aa63-e7d18406ad16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:13:43.438545 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-cb2cfadc-fe39-49f4-9979-aee8f14c82c9 tempest-VolumesExtendTest-844518684 None] Created volume successfully.
Oct 29 21:13:44.438841 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9a9a2be1-3550-4df2-89ef-bbac8abe5ca4 tempest-VolumesExtendTest-844518684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:44.694690 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9a9a2be1-3550-4df2-89ef-bbac8abe5ca4 tempest-VolumesExtendTest-844518684 None] Extend volume from 1 GB to 2 GB. {{(pid=131780) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:2012}}
Oct 29 21:13:44.742614 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-9a9a2be1-3550-4df2-89ef-bbac8abe5ca4 tempest-VolumesExtendTest-844518684 None] Extend volume completed successfully.
Oct 29 21:13:46.309954 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:13:46.364142 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Flow 'volume_create_manager' (dc6c6c21-3110-4b7f-a4e5-e671d609e82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:13:46.374921 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746de9af-98e1-4ad3-a32c-ec9617088d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:46.396393 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746de9af-98e1-4ad3-a32c-ec9617088d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1179079091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=622951c1-ca23-4362-9ac7-f7a09ad640d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4e07d8f2fd42b8938d275b1ae3f6cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:13:46Z,use_quota=True,user_id='377648e5f36c45b6a0a7b88189ce43a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:46.402478 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1ba377-f425-4866-9e4e-97f0e8a0cb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:46.406688 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1ba377-f425-4866-9e4e-97f0e8a0cb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:46.412454 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2484a7f3-93e9-44c5-8593-49440d7667f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:46.417222 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2484a7f3-93e9-44c5-8593-49440d7667f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '622951c1-ca23-4362-9ac7-f7a09ad640d6', 'volume_name': 'volume-622951c1-ca23-4362-9ac7-f7a09ad640d6', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:46.422180 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d66dc1-e48a-49c8-bf7e-455139774658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:46.426774 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d66dc1-e48a-49c8-bf7e-455139774658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:46.433699 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a69800f-64f5-402a-bc17-63d0f2d320c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:46.435048 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Volume 622951c1-ca23-4362-9ac7-f7a09ad640d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-622951c1-ca23-4362-9ac7-f7a09ad640d6', 'volume_size': 1}
Oct 29 21:13:46.435671 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] creating volume 'volume-622951c1-ca23-4362-9ac7-f7a09ad640d6' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:13:46.436584 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:46.606454 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:13:46.607136 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:13:46.614966 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a69800f-64f5-402a-bc17-63d0f2d320c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-622951c1-ca23-4362-9ac7-f7a09ad640d6', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:46.623972 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d7f44d-ad41-456f-962b-3c7949e8d531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:13:46.644936 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Volume volume-622951c1-ca23-4362-9ac7-f7a09ad640d6 (622951c1-ca23-4362-9ac7-f7a09ad640d6): created successfully
Oct 29 21:13:46.653907 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d7f44d-ad41-456f-962b-3c7949e8d531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:13:46.680857 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Flow 'volume_create_manager' (dc6c6c21-3110-4b7f-a4e5-e671d609e82a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:13:46.705736 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-bd803d09-0c97-4cc3-9093-0a0466fe3608 tempest-VolumesExtendTest-844518684 None] Created volume successfully.
Oct 29 21:13:47.682187 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9aa9e531-e803-45b8-98da-6feea9dab520 tempest-VolumesExtendTest-844518684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:48.268096 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-9aa9e531-e803-45b8-98da-6feea9dab520 tempest-VolumesExtendTest-844518684 None] Create snapshot completed successfully
Oct 29 21:13:48.287231 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=58,cinder:INSERT=16,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:13:48.848191 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2c133e74-75ee-47d1-835f-2d2aa934eb0e tempest-VolumesExtendTest-844518684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:48.959677 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2c133e74-75ee-47d1-835f-2d2aa934eb0e tempest-VolumesExtendTest-844518684 None] Extend volume from 1 GB to 2 GB. {{(pid=131780) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:2012}}
Oct 29 21:13:48.993574 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-2c133e74-75ee-47d1-835f-2d2aa934eb0e tempest-VolumesExtendTest-844518684 None] Extend volume completed successfully.
Oct 29 21:13:50.176832 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-74dde143-ad92-4449-b549-1a54ea4e4406 tempest-VolumesExtendTest-844518684 None] Acquiring lock "cinder-b8fb8cda-8f44-48ce-9fe7-7a9a35d5b6ca-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:13:50.233105 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-74dde143-ad92-4449-b549-1a54ea4e4406 tempest-VolumesExtendTest-844518684 None] Lock "cinder-b8fb8cda-8f44-48ce-9fe7-7a9a35d5b6ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:13:50.235443 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-74dde143-ad92-4449-b549-1a54ea4e4406 tempest-VolumesExtendTest-844518684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:51.356106 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-74dde143-ad92-4449-b549-1a54ea4e4406 tempest-VolumesExtendTest-844518684 None] Created reservations ['35ee0a07-669b-4b34-9f9f-85b7ade63df8', '31c5f987-e1e1-49e2-902a-8927070b5c95', '6f2797eb-0c9e-4bb5-a10a-bf75cc0b0dae', '9ea31ef3-3d6a-4e45-aaa8-39f9a71809ff'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:13:51.457424 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-74dde143-ad92-4449-b549-1a54ea4e4406 tempest-VolumesExtendTest-844518684 None] Delete snapshot completed successfully.
Oct 29 21:13:51.467910 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-74dde143-ad92-4449-b549-1a54ea4e4406 tempest-VolumesExtendTest-844518684 None] Lock "cinder-b8fb8cda-8f44-48ce-9fe7-7a9a35d5b6ca-delete_snapshot" released by "delete_snapshot" :: held 1.241s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:13:52.483328 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-4924a24d-8f3b-4be1-860a-b09b5e99764c tempest-VolumesExtendTest-844518684 None] Acquiring lock "cinder-622951c1-ca23-4362-9ac7-f7a09ad640d6-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:13:52.511948 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-4924a24d-8f3b-4be1-860a-b09b5e99764c tempest-VolumesExtendTest-844518684 None] Lock "cinder-622951c1-ca23-4362-9ac7-f7a09ad640d6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:13:52.585773 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4924a24d-8f3b-4be1-860a-b09b5e99764c tempest-VolumesExtendTest-844518684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:52.687823 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4924a24d-8f3b-4be1-860a-b09b5e99764c tempest-VolumesExtendTest-844518684 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:13:52.688510 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4924a24d-8f3b-4be1-860a-b09b5e99764c tempest-VolumesExtendTest-844518684 None] Volume volume-622951c1-ca23-4362-9ac7-f7a09ad640d6 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:13:52.701162 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4924a24d-8f3b-4be1-860a-b09b5e99764c tempest-VolumesExtendTest-844518684 None] deleting rbd volume volume-622951c1-ca23-4362-9ac7-f7a09ad640d6 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:13:53.238764 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-4924a24d-8f3b-4be1-860a-b09b5e99764c tempest-VolumesExtendTest-844518684 None] Created reservations ['4b07bc4c-33cc-4b3f-8aba-33e22603a6d5', 'bb3a7567-8048-4e69-8b7c-7349bd861e2e', 'f23963c5-e14f-440e-80f1-38c265f146f3', 'c2f1ebd2-f958-4f7c-93ca-d6a1e970b4e5'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:13:53.326251 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4924a24d-8f3b-4be1-860a-b09b5e99764c tempest-VolumesExtendTest-844518684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:53.442410 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4924a24d-8f3b-4be1-860a-b09b5e99764c tempest-VolumesExtendTest-844518684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:53.534655 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-4924a24d-8f3b-4be1-860a-b09b5e99764c tempest-VolumesExtendTest-844518684 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:13:53.539983 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4924a24d-8f3b-4be1-860a-b09b5e99764c tempest-VolumesExtendTest-844518684 None] Deleted volume successfully.
Oct 29 21:13:53.559890 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-4924a24d-8f3b-4be1-860a-b09b5e99764c tempest-VolumesExtendTest-844518684 None] Lock "cinder-622951c1-ca23-4362-9ac7-f7a09ad640d6-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:13:53.776473 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b6a5108c-28f2-471d-8b95-04a7ef552f03 tempest-VolumesExtendTest-844518684 None] Acquiring lock "cinder-f8dfedd5-1323-4000-a0b4-5133cbbddc98-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:13:53.788066 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b6a5108c-28f2-471d-8b95-04a7ef552f03 tempest-VolumesExtendTest-844518684 None] Lock "cinder-f8dfedd5-1323-4000-a0b4-5133cbbddc98-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:13:53.905958 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b6a5108c-28f2-471d-8b95-04a7ef552f03 tempest-VolumesExtendTest-844518684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:54.066698 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b6a5108c-28f2-471d-8b95-04a7ef552f03 tempest-VolumesExtendTest-844518684 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:13:54.081006 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b6a5108c-28f2-471d-8b95-04a7ef552f03 tempest-VolumesExtendTest-844518684 None] deleting rbd volume volume-f8dfedd5-1323-4000-a0b4-5133cbbddc98 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:13:54.508770 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b6a5108c-28f2-471d-8b95-04a7ef552f03 tempest-VolumesExtendTest-844518684 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 21:13:54.562001 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b6a5108c-28f2-471d-8b95-04a7ef552f03 tempest-VolumesExtendTest-844518684 None] deleting parent snapshot volume-f8dfedd5-1323-4000-a0b4-5133cbbddc98.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 21:13:55.295140 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=55,cinder:INSERT=5,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:13:55.351443 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-b6a5108c-28f2-471d-8b95-04a7ef552f03 tempest-VolumesExtendTest-844518684 None] Created reservations ['159608cd-f08f-43d4-91bd-2412f0577434', '8d3e6aec-0373-4b72-80a4-fc1f68e4444d', '9f53923d-d671-4224-943b-9c32b29aa1e7', 'be454d85-b7a5-463a-a766-2896737824d7'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:13:55.434816 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b6a5108c-28f2-471d-8b95-04a7ef552f03 tempest-VolumesExtendTest-844518684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:55.489140 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b6a5108c-28f2-471d-8b95-04a7ef552f03 tempest-VolumesExtendTest-844518684 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:13:55.564467 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-b6a5108c-28f2-471d-8b95-04a7ef552f03 tempest-VolumesExtendTest-844518684 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:13:55.569718 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b6a5108c-28f2-471d-8b95-04a7ef552f03 tempest-VolumesExtendTest-844518684 None] Deleted volume successfully.
Oct 29 21:13:55.591518 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b6a5108c-28f2-471d-8b95-04a7ef552f03 tempest-VolumesExtendTest-844518684 None] Lock "cinder-f8dfedd5-1323-4000-a0b4-5133cbbddc98-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:14:01.387790 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:14:01.388927 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:14:01.442363 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:14:01.521247 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:14:01.578775 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:14:01.612388 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Flow 'volume_create_manager' (644156c7-bf8f-4e50-8310-89074140a3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:14:01.630884 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab76e9c-f2cf-4af6-a585-b68f6597147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:14:01.653118 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab76e9c-f2cf-4af6-a585-b68f6597147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-347348977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b6823076-879e-4467-9be0-aadbacfa9d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10601894adb44985b208c3ab7ffa22c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:14:02Z,use_quota=True,user_id='04bbe6295ba34150b3609466e42c8abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:14:01.658538 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67493cce-aa88-4dbb-afa6-071f94fabe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:14:01.663113 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67493cce-aa88-4dbb-afa6-071f94fabe57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:14:01.669022 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4654ee8-5078-4289-a39f-b2f3d694af79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:14:01.786210 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4654ee8-5078-4289-a39f-b2f3d694af79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b6823076-879e-4467-9be0-aadbacfa9d45', 'volume_name': 'volume-b6823076-879e-4467-9be0-aadbacfa9d45', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93468c82e0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:14:01.801150 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe6c629-94e5-4ad8-9b73-0cf5830cbcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:14:01.807130 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe6c629-94e5-4ad8-9b73-0cf5830cbcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:14:01.812454 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530a8cbe-186d-4929-a6d7-82db38c5c5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:14:01.814098 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Volume b6823076-879e-4467-9be0-aadbacfa9d45: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b6823076-879e-4467-9be0-aadbacfa9d45', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93468c82e0>}
Oct 29 21:14:01.815014 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Cloning b6823076-879e-4467-9be0-aadbacfa9d45 from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 21:14:01.816030 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:14:01.830177 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:14:01.856232 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 14, 1, 842338)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:14:01.856669 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:14:01.857063 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Found cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 29 21:14:01.867350 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 0.037s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:14:01.868298 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 21:14:01.876459 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 14, 1, 873735)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:14:01.877070 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:14:01.877903 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Creating from source image-volume fbe0dd2e-351a-4779-844d-3c66baf14939 {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 29 21:14:01.894141 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:14:01.984796 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] creating snapshot='volume-b6823076-879e-4467-9be0-aadbacfa9d45.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 21:14:03.001182 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] cloning 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939@volume-b6823076-879e-4467-9be0-aadbacfa9d45.clone_snap' to 'volume-b6823076-879e-4467-9be0-aadbacfa9d45' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 21:14:03.184329 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:14:03.185872 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:14:03.186589 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:14:03.248338 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 21:14:03.249891 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Marking volume b6823076-879e-4467-9be0-aadbacfa9d45 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 21:14:03.263542 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to b6823076-879e-4467-9be0-aadbacfa9d45. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 21:14:03.264203 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Creating volume glance metadata for volume b6823076-879e-4467-9be0-aadbacfa9d45 backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 21:14:03.357778 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530a8cbe-186d-4929-a6d7-82db38c5c5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6823076-879e-4467-9be0-aadbacfa9d45', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93468c82e0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:14:03.365342 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (667a0d21-e4f7-40c3-a162-db93898b1973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:14:03.378340 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Volume volume-b6823076-879e-4467-9be0-aadbacfa9d45 (b6823076-879e-4467-9be0-aadbacfa9d45): created successfully
Oct 29 21:14:03.383979 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (667a0d21-e4f7-40c3-a162-db93898b1973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:14:03.393926 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Flow 'volume_create_manager' (644156c7-bf8f-4e50-8310-89074140a3e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:14:03.399117 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=59,cinder:UPDATE=20,cinder:INSERT=19,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:14:03.408412 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-96610e47-a788-4ebb-ae04-7117b5ccc41b tempest-VolumesSnapshotTestJSON-1969201650 None] Created volume successfully.
Oct 29 21:14:04.258876 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-a77926ca-1f1b-4cf0-be67-23e7f0393ee6 req-dcf42a98-30ec-4330-9e35-8e72cd213f82 tempest-VolumesSnapshotTestJSON-1969201650 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:14:05.584626 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-a77926ca-1f1b-4cf0-be67-23e7f0393ee6 req-dcf42a98-30ec-4330-9e35-8e72cd213f82 tempest-VolumesSnapshotTestJSON-1969201650 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.321s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:14:05.586302 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-a77926ca-1f1b-4cf0-be67-23e7f0393ee6 req-dcf42a98-30ec-4330-9e35-8e72cd213f82 tempest-VolumesSnapshotTestJSON-1969201650 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b6823076-879e-4467-9be0-aadbacfa9d45', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'b6823076-879e-4467-9be0-aadbacfa9d45', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:14:05.640617 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-a77926ca-1f1b-4cf0-be67-23e7f0393ee6 req-dcf42a98-30ec-4330-9e35-8e72cd213f82 tempest-VolumesSnapshotTestJSON-1969201650 None] Connection info returned from driver {'name': 'volumes/volume-b6823076-879e-4467-9be0-aadbacfa9d45', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b6823076-879e-4467-9be0-aadbacfa9d45', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd1d7c5ce-9b60-4fe1-a440-e68c67115509'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:14:05.722800 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-a77926ca-1f1b-4cf0-be67-23e7f0393ee6 req-dcf42a98-30ec-4330-9e35-8e72cd213f82 tempest-VolumesSnapshotTestJSON-1969201650 None] attachment_update completed successfully.
Oct 29 21:14:07.774241 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d48f6fa2-ead4-4f0d-a03a-37cf9356441b tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:14:08.237928 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-d48f6fa2-ead4-4f0d-a03a-37cf9356441b tempest-VolumesSnapshotTestJSON-1969201650 None] Create snapshot completed successfully
Oct 29 21:14:09.044858 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7f62cbcb-246e-44d3-94b3-9b7f8338da01 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:14:10.314958 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7f62cbcb-246e-44d3-94b3-9b7f8338da01 tempest-VolumesSnapshotTestJSON-1969201650 None] Create snapshot completed successfully
Oct 29 21:14:11.460131 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-912ab7f1-01ff-4f3e-a29f-5e50144a94c0 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:14:12.387587 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-912ab7f1-01ff-4f3e-a29f-5e50144a94c0 tempest-VolumesSnapshotTestJSON-1969201650 None] Create snapshot completed successfully
Oct 29 21:14:12.568279 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e5ec0941-41c7-4387-bb3d-1ec83b527ab2 tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-4205ba51-6a2a-4c48-8c95-d125fe91b0d4-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:14:12.585608 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e5ec0941-41c7-4387-bb3d-1ec83b527ab2 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-4205ba51-6a2a-4c48-8c95-d125fe91b0d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:14:12.593483 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e5ec0941-41c7-4387-bb3d-1ec83b527ab2 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:14:13.061695 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=60,cinder:UPDATE=18,cinder:INSERT=20,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:14:23.070162 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=34,cinder:UPDATE=5,cinder:INSERT=18,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:14:31.705498 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-e7041b13-b9d6-49ad-a517-77c58702816f req-3c2fd861-7b41-4d0e-8b1a-0a86ae723cec tempest-AttachVolumeNegativeTest-2104062597 None] Terminate volume connection completed successfully.
Oct 29 21:14:31.709059 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e7041b13-b9d6-49ad-a517-77c58702816f req-3c2fd861-7b41-4d0e-8b1a-0a86ae723cec tempest-AttachVolumeNegativeTest-2104062597 None] Deleting attachment c6690b19-3f86-4187-80a3-dda0ebfaa0d0. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:14:42.479441 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:14:42.499696 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Flow 'volume_create_manager' (0a5c87d6-8024-4f5a-ba37-fe5f7839bdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:14:42.506624 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5f24ff-60bf-4a2f-ab18-4eb9aaf47537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:14:42.534152 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5f24ff-60bf-4a2f-ab18-4eb9aaf47537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1126230242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=08642dd9-e507-4301-87f6-062a368e0852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad443ad0828409d8aada4cf90bfc696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:14:42Z,use_quota=True,user_id='2c6db5dbdaf2447d8c158f1a8076b290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:14:42.539476 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779f76ba-77a2-4e80-83c8-4923cb740dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:14:42.544138 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779f76ba-77a2-4e80-83c8-4923cb740dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:14:42.549187 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8fcfaf8-1516-4e35-a9b0-d5e02e028607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:14:42.553580 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8fcfaf8-1516-4e35-a9b0-d5e02e028607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08642dd9-e507-4301-87f6-062a368e0852', 'volume_name': 'volume-08642dd9-e507-4301-87f6-062a368e0852', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:14:42.558744 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130d1cb8-edab-4ac0-83f5-27bd435c8285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:14:42.562444 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130d1cb8-edab-4ac0-83f5-27bd435c8285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:14:42.567251 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5b555b-9528-49bf-b8d5-cba42dc802f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:14:42.568373 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Volume 08642dd9-e507-4301-87f6-062a368e0852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08642dd9-e507-4301-87f6-062a368e0852', 'volume_size': 1}
Oct 29 21:14:42.568866 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] creating volume 'volume-08642dd9-e507-4301-87f6-062a368e0852' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:14:42.569703 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:14:42.680714 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:14:42.681117 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:14:42.685779 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5b555b-9528-49bf-b8d5-cba42dc802f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08642dd9-e507-4301-87f6-062a368e0852', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:14:42.692015 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a044b93-3149-4aa5-85d0-289b0831ed5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:14:42.704620 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Volume volume-08642dd9-e507-4301-87f6-062a368e0852 (08642dd9-e507-4301-87f6-062a368e0852): created successfully
Oct 29 21:14:42.710520 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a044b93-3149-4aa5-85d0-289b0831ed5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:14:42.718674 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Flow 'volume_create_manager' (0a5c87d6-8024-4f5a-ba37-fe5f7839bdad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:14:42.730531 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-d54c1616-b7be-45c2-b27d-f3cba36657d0 tempest-AttachVolumeShelveTestJSON-1635390820 None] Created volume successfully.
Oct 29 21:14:42.884423 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-e5ec0941-41c7-4387-bb3d-1ec83b527ab2 tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['ab1e848f-074c-476b-9e55-7ce27f45e967', 'd99e2852-1f91-419a-9072-9dc4d66597e2', '990ad8d2-2c22-4444-8fc1-fe8add080d7a', '246cd260-a5f3-4c9b-9dbe-d81272d5876d'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:14:42.945886 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-e5ec0941-41c7-4387-bb3d-1ec83b527ab2 tempest-VolumesSnapshotTestJSON-1969201650 None] Delete snapshot completed successfully.
Oct 29 21:14:42.954692 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e5ec0941-41c7-4387-bb3d-1ec83b527ab2 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-4205ba51-6a2a-4c48-8c95-d125fe91b0d4-delete_snapshot" released by "delete_snapshot" :: held 30.369s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:14:43.120644 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ff741325-1005-456c-b1bd-96fd6ac06515 tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-172a1e3a-7127-4cfb-92c3-fe9fbcc774b3-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:14:43.130985 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ff741325-1005-456c-b1bd-96fd6ac06515 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-172a1e3a-7127-4cfb-92c3-fe9fbcc774b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:14:43.133056 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ff741325-1005-456c-b1bd-96fd6ac06515 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:14:52.940140 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=20,cinder:UPDATE=9,cinder:DELETE=1,cinder:INSERT=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:15:01.392515 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:15:01.393281 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:15:01.469106 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:15:01.564462 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:15:03.088506 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=20,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:15:13.119116 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:15:13.383047 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-ff741325-1005-456c-b1bd-96fd6ac06515 tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['abea356d-703a-49a0-9647-57c3b187897f', '2abc1c8a-512a-4ca1-8c40-515ad2db48a7', 'f92b806b-c6e5-408f-9f7e-28b5bed153fa', '03c95647-3b0e-4dd2-846f-a1a6bfcf7c48'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:15:13.459855 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-ff741325-1005-456c-b1bd-96fd6ac06515 tempest-VolumesSnapshotTestJSON-1969201650 None] Delete snapshot completed successfully.
Oct 29 21:15:13.475564 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ff741325-1005-456c-b1bd-96fd6ac06515 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-172a1e3a-7127-4cfb-92c3-fe9fbcc774b3-delete_snapshot" released by "delete_snapshot" :: held 30.344s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:15:13.601739 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-321e8bfe-a46d-4148-9fca-eeb7ff75fc88 tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-636fac8c-a3c6-4797-a367-fc8ce101d292-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:15:13.642500 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-321e8bfe-a46d-4148-9fca-eeb7ff75fc88 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-636fac8c-a3c6-4797-a367-fc8ce101d292-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:15:13.647719 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-321e8bfe-a46d-4148-9fca-eeb7ff75fc88 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:15:29.662991 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4a741331-e21f-4036-836d-bfbcd6dfebb3 req-9e59724d-a80b-43c0-8da6-5b9c74799f6a tempest-AttachVolumeShelveTestJSON-1635390820 None] No connector for attachment 8cea5bfd-fc16-45f1-8b57-1ffa92032d61; skipping storage backend terminate_connection call. {{(pid=131780) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4953}}
Oct 29 21:15:29.665251 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4a741331-e21f-4036-836d-bfbcd6dfebb3 req-9e59724d-a80b-43c0-8da6-5b9c74799f6a tempest-AttachVolumeShelveTestJSON-1635390820 None] Deleting attachment 8cea5bfd-fc16-45f1-8b57-1ffa92032d61. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:15:43.071363 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=22,cinder:UPDATE=10,cinder:INSERT=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:15:43.901022 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:15:43.962764 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-321e8bfe-a46d-4148-9fca-eeb7ff75fc88 tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['9f7fa44a-1803-4c08-8df5-ff43178165e8', 'a4a42f58-99b4-4f89-b719-becbd678bc45', '8ac689fa-40f5-4ca3-a528-542c9ef042e1', '80219ce7-0def-40d7-9313-0ed87d4c653b'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:15:44.044374 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-321e8bfe-a46d-4148-9fca-eeb7ff75fc88 tempest-VolumesSnapshotTestJSON-1969201650 None] Delete snapshot completed successfully.
Oct 29 21:15:44.055675 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-321e8bfe-a46d-4148-9fca-eeb7ff75fc88 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-636fac8c-a3c6-4797-a367-fc8ce101d292-delete_snapshot" released by "delete_snapshot" :: held 30.413s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:15:45.398652 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-ee16777c-0f8a-4957-a943-1e38222117bc req-3bafc805-2c33-492e-9196-7679b137da1c tempest-VolumesSnapshotTestJSON-1969201650 None] Terminate volume connection completed successfully.
Oct 29 21:15:45.400006 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-ee16777c-0f8a-4957-a943-1e38222117bc req-3bafc805-2c33-492e-9196-7679b137da1c tempest-VolumesSnapshotTestJSON-1969201650 None] Deleting attachment d1d7c5ce-9b60-4fe1-a440-e68c67115509. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:15:46.859160 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7d963229-285b-4515-af35-55334267cb81 tempest-GroupsTest-1442030713 None] Group tempest-Group1-2128197492: creating
Oct 29 21:15:46.889758 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7d963229-285b-4515-af35-55334267cb81 tempest-GroupsTest-1442030713 None] Group tempest-Group1-2128197492: created successfully
Oct 29 21:15:46.905545 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7d963229-285b-4515-af35-55334267cb81 tempest-GroupsTest-1442030713 None] Create group completed successfully.
Oct 29 21:15:48.112859 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-acba9d01-3022-42b6-8c25-ab1c81c58f12 tempest-GroupsTest-1442030713 None] Group tempest-Group2-1761219397: creating
Oct 29 21:15:48.139295 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-acba9d01-3022-42b6-8c25-ab1c81c58f12 tempest-GroupsTest-1442030713 None] Group tempest-Group2-1761219397: created successfully
Oct 29 21:15:48.154184 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-acba9d01-3022-42b6-8c25-ab1c81c58f12 tempest-GroupsTest-1442030713 None] Create group completed successfully.
Oct 29 21:15:49.858503 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:15:49.896112 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Flow 'volume_create_manager' (df05dbf1-cca6-4871-8d31-9d1d1454568d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:15:49.906262 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c381c02-470f-4dfe-8b7e-262d3506a98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:49.928385 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c381c02-470f-4dfe-8b7e-262d3506a98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1448105721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fbfcd5ec-41dc-47bf-a626-480db305307e,host='ncdv-master-1@ceph#ceph',id=eeb5414d-bc93-42cf-95ab-4464d9e4584b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af43102c1d1844a1ae85ccaec912cf22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:15:50Z,use_quota=True,user_id='92bf335c04884b1d8ca9107e15d512a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56310165-09cd-448d-bf72-58f717b1a96f),volume_type_id=56310165-09cd-448d-bf72-58f717b1a96f)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:49.934051 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0310e96-1331-431f-bfbd-df908ccc465d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:49.938255 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0310e96-1331-431f-bfbd-df908ccc465d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:49.944478 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5ab8d8-e896-43c7-93fc-ea72e820506b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:49.949947 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5ab8d8-e896-43c7-93fc-ea72e820506b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb5414d-bc93-42cf-95ab-4464d9e4584b', 'volume_name': 'volume-eeb5414d-bc93-42cf-95ab-4464d9e4584b', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:49.955267 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240b5c4d-d716-4524-9da4-90613b3948af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:49.960986 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240b5c4d-d716-4524-9da4-90613b3948af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:49.968432 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5b2d4d-f4cc-4fc6-a550-af3c140d44a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:49.969965 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Volume eeb5414d-bc93-42cf-95ab-4464d9e4584b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb5414d-bc93-42cf-95ab-4464d9e4584b', 'volume_size': 1}
Oct 29 21:15:49.970546 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] creating volume 'volume-eeb5414d-bc93-42cf-95ab-4464d9e4584b' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:15:49.972244 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:15:50.065840 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] extra_specs: {} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:15:50.066303 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] extra_specs: {} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:15:50.070613 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5b2d4d-f4cc-4fc6-a550-af3c140d44a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb5414d-bc93-42cf-95ab-4464d9e4584b', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:50.079880 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c840a13e-1ac9-43fc-a6c0-f66b4f4808c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:50.098513 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Volume volume-eeb5414d-bc93-42cf-95ab-4464d9e4584b (eeb5414d-bc93-42cf-95ab-4464d9e4584b): created successfully
Oct 29 21:15:50.106659 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c840a13e-1ac9-43fc-a6c0-f66b4f4808c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:50.124084 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Flow 'volume_create_manager' (df05dbf1-cca6-4871-8d31-9d1d1454568d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:15:50.149620 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-13c4d827-29b0-47d6-b998-cf9421f05390 tempest-GroupsTest-1442030713 None] Created volume successfully.
Oct 29 21:15:50.488589 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1da581f0-6e02-4293-ac30-56b11c775603 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:15:51.572903 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d7801347-77c8-468d-bc8b-2b666af5281a tempest-GroupsTest-1442030713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:15:51.679845 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d7801347-77c8-468d-bc8b-2b666af5281a tempest-GroupsTest-1442030713 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:15:51.680303 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d7801347-77c8-468d-bc8b-2b666af5281a tempest-GroupsTest-1442030713 None] Volume volume-eeb5414d-bc93-42cf-95ab-4464d9e4584b is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:15:51.698080 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d7801347-77c8-468d-bc8b-2b666af5281a tempest-GroupsTest-1442030713 None] deleting rbd volume volume-eeb5414d-bc93-42cf-95ab-4464d9e4584b {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:15:51.770404 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1da581f0-6e02-4293-ac30-56b11c775603 tempest-VolumesSnapshotTestJSON-1969201650 None] Create snapshot completed successfully
Oct 29 21:15:52.087210 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-d7801347-77c8-468d-bc8b-2b666af5281a tempest-GroupsTest-1442030713 None] Created reservations ['e8e33dc1-660d-4d6b-bab7-f504325bb7e1'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:15:52.107654 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-d7801347-77c8-468d-bc8b-2b666af5281a tempest-GroupsTest-1442030713 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-639976895 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-639976895, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:15:52.108459 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-d7801347-77c8-468d-bc8b-2b666af5281a tempest-GroupsTest-1442030713 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-639976895 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-639976895, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:15:52.130596 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-d7801347-77c8-468d-bc8b-2b666af5281a tempest-GroupsTest-1442030713 None] Created reservations ['c8a379d0-829e-4471-a9ab-67ad03e4d9f8', 'dfabc9d8-7034-4bdb-bba4-8ea5720ad290', '99297304-8957-43ae-91ce-ef564bcfd91e', '12297373-34d0-4e85-876d-41456143c070'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:15:52.270372 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d7801347-77c8-468d-bc8b-2b666af5281a tempest-GroupsTest-1442030713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:15:52.319131 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d7801347-77c8-468d-bc8b-2b666af5281a tempest-GroupsTest-1442030713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:15:52.370291 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-d7801347-77c8-468d-bc8b-2b666af5281a tempest-GroupsTest-1442030713 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:15:52.379736 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-d7801347-77c8-468d-bc8b-2b666af5281a tempest-GroupsTest-1442030713 None] Delete group completed successfully.
Oct 29 21:15:53.024716 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-3fa4e2ba-8ece-4191-915d-7d1d85bd8b8d tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-b65ec267-62fb-4c55-ba42-dabc214be7a2-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:15:53.055208 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-e9a13b20-528f-4d81-8fe8-f262e4bae96d tempest-GroupsTest-1442030713 None] Created reservations ['e34ceb43-e166-4379-b49a-ae9128e53f7e'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:15:53.068143 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-3fa4e2ba-8ece-4191-915d-7d1d85bd8b8d tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-b65ec267-62fb-4c55-ba42-dabc214be7a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:15:53.071385 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3fa4e2ba-8ece-4191-915d-7d1d85bd8b8d tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:15:53.228126 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e9a13b20-528f-4d81-8fe8-f262e4bae96d tempest-GroupsTest-1442030713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:15:53.300926 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e9a13b20-528f-4d81-8fe8-f262e4bae96d tempest-GroupsTest-1442030713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:15:53.374130 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-e9a13b20-528f-4d81-8fe8-f262e4bae96d tempest-GroupsTest-1442030713 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:15:53.378188 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-e9a13b20-528f-4d81-8fe8-f262e4bae96d tempest-GroupsTest-1442030713 None] Delete group completed successfully.
Oct 29 21:15:53.769956 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-3fa4e2ba-8ece-4191-915d-7d1d85bd8b8d tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['bd5ba0ed-c9e7-44de-94d1-11066ab46b23', '51f2bfed-e5c2-433d-b5ec-be42c0798902', '0d9a1631-efb8-47cd-8977-364f509eee8e', 'f25b3436-828d-42eb-8a21-ae4b0f9b596b'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:15:53.797358 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=63,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:15:53.841007 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=69,cinder:INSERT=8,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:15:53.877505 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-3fa4e2ba-8ece-4191-915d-7d1d85bd8b8d tempest-VolumesSnapshotTestJSON-1969201650 None] Delete snapshot completed successfully.
Oct 29 21:15:53.885019 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-3fa4e2ba-8ece-4191-915d-7d1d85bd8b8d tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-b65ec267-62fb-4c55-ba42-dabc214be7a2-delete_snapshot" released by "delete_snapshot" :: held 0.817s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:15:54.464710 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-141ae5c4-07d5-4d37-9542-04ef040ef164 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:15:54.692138 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-141ae5c4-07d5-4d37-9542-04ef040ef164 tempest-VolumesSnapshotTestJSON-1969201650 None] Create snapshot completed successfully
Oct 29 21:15:54.932948 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-37e872f1-acb1-42b6-b818-cd18dfd5e893 tempest-GroupsTest-1442030713 None] Group tempest-GroupsTest-Group-1950983073: creating
Oct 29 21:15:54.952010 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-37e872f1-acb1-42b6-b818-cd18dfd5e893 tempest-GroupsTest-1442030713 None] Group tempest-GroupsTest-Group-1950983073: created successfully
Oct 29 21:15:54.963812 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-37e872f1-acb1-42b6-b818-cd18dfd5e893 tempest-GroupsTest-1442030713 None] Create group completed successfully.
Oct 29 21:15:56.430755 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:15:56.460263 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Flow 'volume_create_manager' (a18e889c-2e65-4994-9fbe-0a71340ec252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:15:56.469508 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67484b87-6de9-4486-b602-f3c180d5eb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:56.495042 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67484b87-6de9-4486-b602-f3c180d5eb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1066212256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b6b85940-fab0-4427-a983-dcb8615a263c,host='ncdv-master-1@ceph#ceph',id=265f1331-0c2e-4038-a3f2-605682ba3a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af43102c1d1844a1ae85ccaec912cf22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:15:56Z,use_quota=True,user_id='92bf335c04884b1d8ca9107e15d512a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5f23b25-6464-44ae-8778-3775bc569ff7),volume_type_id=d5f23b25-6464-44ae-8778-3775bc569ff7)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:56.501482 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc2a1b8-66d0-41db-b1a0-08a1e9ad66f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:56.506657 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc2a1b8-66d0-41db-b1a0-08a1e9ad66f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:56.512277 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dea274f-ba18-4c46-abd2-5b94418c2096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:56.517337 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dea274f-ba18-4c46-abd2-5b94418c2096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '265f1331-0c2e-4038-a3f2-605682ba3a4a', 'volume_name': 'volume-265f1331-0c2e-4038-a3f2-605682ba3a4a', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:56.524815 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd222dd-fdba-4f11-9054-a6dce89d5908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:56.529204 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd222dd-fdba-4f11-9054-a6dce89d5908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:56.535350 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e128d6-c6bf-4d1f-ba00-a6e9528d44d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:56.536683 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Volume 265f1331-0c2e-4038-a3f2-605682ba3a4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-265f1331-0c2e-4038-a3f2-605682ba3a4a', 'volume_size': 1}
Oct 29 21:15:56.537204 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] creating volume 'volume-265f1331-0c2e-4038-a3f2-605682ba3a4a' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:15:56.538850 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:15:56.615557 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] extra_specs: {} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:15:56.616326 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] extra_specs: {} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:15:56.619968 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50e128d6-c6bf-4d1f-ba00-a6e9528d44d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-265f1331-0c2e-4038-a3f2-605682ba3a4a', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:56.624673 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c21ba5-6022-4fcf-8802-b11cd9f0c101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:56.643279 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Volume volume-265f1331-0c2e-4038-a3f2-605682ba3a4a (265f1331-0c2e-4038-a3f2-605682ba3a4a): created successfully
Oct 29 21:15:56.650949 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c21ba5-6022-4fcf-8802-b11cd9f0c101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:56.656970 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Flow 'volume_create_manager' (a18e889c-2e65-4994-9fbe-0a71340ec252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:15:56.668679 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-eaa82082-64c1-47c7-8b54-70cf735f2b1b tempest-GroupsTest-1442030713 None] Created volume successfully.
Oct 29 21:15:58.051350 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:15:58.101572 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Flow 'volume_create_manager' (3e5ad37a-92e2-45bb-9ba1-b1d6a8df26af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:15:58.112724 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d28197-fc52-401a-aaa9-8e8b9f8f5289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:58.144185 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d28197-fc52-401a-aaa9-8e8b9f8f5289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1542156752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b6b85940-fab0-4427-a983-dcb8615a263c,host='ncdv-master-1@ceph#ceph',id=947178d9-8927-4926-826d-3f0767b61daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af43102c1d1844a1ae85ccaec912cf22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:15:58Z,use_quota=True,user_id='92bf335c04884b1d8ca9107e15d512a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5f23b25-6464-44ae-8778-3775bc569ff7),volume_type_id=d5f23b25-6464-44ae-8778-3775bc569ff7)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:58.149407 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607dae96-3b39-4c99-ba36-9f6be82001f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:58.153509 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (607dae96-3b39-4c99-ba36-9f6be82001f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:58.159046 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28467d51-f521-438b-aeb9-d07b724a44b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:58.163682 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28467d51-f521-438b-aeb9-d07b724a44b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '947178d9-8927-4926-826d-3f0767b61daa', 'volume_name': 'volume-947178d9-8927-4926-826d-3f0767b61daa', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:58.168444 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30789af7-e146-476f-9e8c-4304848f85d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:58.173977 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30789af7-e146-476f-9e8c-4304848f85d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:58.180197 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f89054e-1a52-4211-9458-5e8bf22b7ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:58.181572 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Volume 947178d9-8927-4926-826d-3f0767b61daa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-947178d9-8927-4926-826d-3f0767b61daa', 'volume_size': 1}
Oct 29 21:15:58.182124 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] creating volume 'volume-947178d9-8927-4926-826d-3f0767b61daa' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:15:58.182950 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:15:58.265520 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] extra_specs: {} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:15:58.266317 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] extra_specs: {} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:15:58.271824 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f89054e-1a52-4211-9458-5e8bf22b7ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947178d9-8927-4926-826d-3f0767b61daa', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:58.278327 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79132365-ace7-453a-8a0d-df95555f8819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:15:58.290214 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Volume volume-947178d9-8927-4926-826d-3f0767b61daa (947178d9-8927-4926-826d-3f0767b61daa): created successfully
Oct 29 21:15:58.295398 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79132365-ace7-453a-8a0d-df95555f8819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:15:58.302221 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Flow 'volume_create_manager' (3e5ad37a-92e2-45bb-9ba1-b1d6a8df26af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:15:58.315638 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-35e0398f-2503-4c0d-aa59-b13db0793c6e tempest-GroupsTest-1442030713 None] Created volume successfully.
Oct 29 21:15:59.395805 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-3109b367-7631-43e0-a007-9c7fe01ca43d tempest-GroupsTest-1442030713 None] Update group completed successfully.
Oct 29 21:16:00.806179 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-51346018-fc32-44ab-94f7-065f1c5f85c7 tempest-GroupsTest-1442030713 None] Update group completed successfully.
Oct 29 21:16:01.392095 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:16:01.393075 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:01.473171 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:01.568254 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:16:02.514285 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:02.594242 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:16:02.594776 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] Volume volume-265f1331-0c2e-4038-a3f2-605682ba3a4a is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:16:02.599073 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] deleting rbd volume volume-265f1331-0c2e-4038-a3f2-605682ba3a4a {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:16:02.793232 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:02.867381 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:16:02.867837 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] Volume volume-947178d9-8927-4926-826d-3f0767b61daa is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:16:02.873324 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] deleting rbd volume volume-947178d9-8927-4926-826d-3f0767b61daa {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:16:03.247040 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] Created reservations ['05a9c702-a73e-4b2c-9035-9273e1809067'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:16:03.283349 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1619227853 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1619227853, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:16:03.286088 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1619227853 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1619227853, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:16:03.328334 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] Created reservations ['6647c5ea-55c9-4d7d-9a57-1604bd312283', '202ed2aa-d5f0-4ef3-9eec-ed5dd6b48d5c', '0e7d8a64-cb3b-4663-ab1b-5f37bf53795d', '16a9dff9-2386-4884-ba41-faf7304454a7'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:16:03.547050 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] Created reservations ['dda6018d-f748-4e6f-9972-28a28aee1c8c', 'acf24e4b-e48a-46b9-892c-516f85dbab68', 'ae898c1a-079b-4728-9d7a-c3078750220d', '0fb92c59-4d27-4daf-a9a8-e55e39b942a3'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:16:03.809204 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:03.906270 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:03.994694 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:16:04.010146 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-41ac4f40-72bb-4843-89ed-ebf66ff1f799 tempest-GroupsTest-1442030713 None] Delete group completed successfully.
Oct 29 21:16:08.749923 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:16:08.775754 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Flow 'volume_create_manager' (76f4a9a7-6829-4245-b81e-d36249fa26b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:16:08.783782 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1877c2-266d-417c-a2a5-8e3c47d2a590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:08.819796 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1877c2-266d-417c-a2a5-8e3c47d2a590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-147241019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3e2d09bb-2c91-470b-a1b9-7393e264eb22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbee029e55124f2bb37672fbee64a42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:16:09Z,use_quota=True,user_id='f21c99f8530a41439b59b8dbaf2369dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:08.831110 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8933a732-4283-4342-b5fe-605a60801e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:08.837174 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8933a732-4283-4342-b5fe-605a60801e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:08.845368 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caf10b5-c2a5-42c5-a191-f2e6b3c56d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:08.850570 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caf10b5-c2a5-42c5-a191-f2e6b3c56d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2d09bb-2c91-470b-a1b9-7393e264eb22', 'volume_name': 'volume-3e2d09bb-2c91-470b-a1b9-7393e264eb22', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:08.855805 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82338ae-45e3-4cc2-96e6-b4063f7b4ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:08.860318 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b82338ae-45e3-4cc2-96e6-b4063f7b4ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:08.866505 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9c32fa-2a16-4332-8bfa-20f99fc14d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:08.867633 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Volume 3e2d09bb-2c91-470b-a1b9-7393e264eb22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2d09bb-2c91-470b-a1b9-7393e264eb22', 'volume_size': 1}
Oct 29 21:16:08.868092 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] creating volume 'volume-3e2d09bb-2c91-470b-a1b9-7393e264eb22' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:16:08.868879 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:08.998241 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:16:08.998919 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:16:09.003452 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9c32fa-2a16-4332-8bfa-20f99fc14d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2d09bb-2c91-470b-a1b9-7393e264eb22', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:09.011755 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f02848e-a30d-456e-87a7-a0021044cf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:09.028438 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Volume volume-3e2d09bb-2c91-470b-a1b9-7393e264eb22 (3e2d09bb-2c91-470b-a1b9-7393e264eb22): created successfully
Oct 29 21:16:09.040054 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f02848e-a30d-456e-87a7-a0021044cf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:09.062285 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Flow 'volume_create_manager' (76f4a9a7-6829-4245-b81e-d36249fa26b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:16:09.079728 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=32,cinder:SELECT=62,cinder:INSERT=6 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:16:09.088454 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-dd5843e3-0ea5-481c-9394-f62c4c47c2d4 tempest-AttachVolumeNegativeTest-2104062597 None] Created volume successfully.
Oct 29 21:16:10.782122 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-3c5160a9-3439-479f-a114-f6673553b2c1 req-d7705803-08bd-4d0b-9b2f-c50afa41f174 tempest-AttachVolumeNegativeTest-2104062597 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:16:11.207709 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:16:11.254491 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Flow 'volume_create_manager' (46e908b5-a6a7-4fa9-9717-96015fb31b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:16:11.265254 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21cfeab-91dc-4c29-a231-fcef6fb7ce03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:11.308589 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21cfeab-91dc-4c29-a231-fcef6fb7ce03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-2072359407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64e7efc6ad0243d3aed9eaed70c2f583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:16:11Z,use_quota=True,user_id='c3b47c52daa24b928842a5ba03683624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:11.314121 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0785c6-1822-4a64-829a-890e3e3e35f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:11.318287 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0785c6-1822-4a64-829a-890e3e3e35f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:11.323938 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28974afc-ea91-4307-90a5-4e832295cd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:11.328189 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28974afc-ea91-4307-90a5-4e832295cd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc', 'volume_name': 'volume-d4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:11.333850 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d472b6-9fa9-4fcf-a154-6c7ff8783294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:11.338732 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d472b6-9fa9-4fcf-a154-6c7ff8783294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:11.343494 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f3ff6a-b885-410d-a263-79cbe0d15dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:11.344775 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Volume d4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc', 'volume_size': 1}
Oct 29 21:16:11.347130 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] creating volume 'volume-d4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:16:11.348080 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:11.475730 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:16:11.476213 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:16:11.480478 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f3ff6a-b885-410d-a263-79cbe0d15dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:11.485185 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7746addf-462f-4a0b-9411-edccf2b0cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:11.504492 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Volume volume-d4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc (d4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc): created successfully
Oct 29 21:16:11.509114 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7746addf-462f-4a0b-9411-edccf2b0cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:11.526617 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Flow 'volume_create_manager' (46e908b5-a6a7-4fa9-9717-96015fb31b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:16:11.547401 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-731e4267-cd95-444b-9f67-cf66a68ddd25 tempest-VolumesBackupsAdminTest-356851268 None] Created volume successfully.
Oct 29 21:16:12.058698 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-3c5160a9-3439-479f-a114-f6673553b2c1 req-d7705803-08bd-4d0b-9b2f-c50afa41f174 tempest-AttachVolumeNegativeTest-2104062597 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.277s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:16:12.060175 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-3c5160a9-3439-479f-a114-f6673553b2c1 req-d7705803-08bd-4d0b-9b2f-c50afa41f174 tempest-AttachVolumeNegativeTest-2104062597 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3e2d09bb-2c91-470b-a1b9-7393e264eb22', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '3e2d09bb-2c91-470b-a1b9-7393e264eb22', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:16:12.072933 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=30,cinder:SELECT=62,cinder:DELETE=5,cinder:INSERT=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:16:12.090245 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-3c5160a9-3439-479f-a114-f6673553b2c1 req-d7705803-08bd-4d0b-9b2f-c50afa41f174 tempest-AttachVolumeNegativeTest-2104062597 None] Connection info returned from driver {'name': 'volumes/volume-3e2d09bb-2c91-470b-a1b9-7393e264eb22', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3e2d09bb-2c91-470b-a1b9-7393e264eb22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8f225d8e-9935-4904-9cb5-45f671d680ba'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:16:12.184945 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-3c5160a9-3439-479f-a114-f6673553b2c1 req-d7705803-08bd-4d0b-9b2f-c50afa41f174 tempest-AttachVolumeNegativeTest-2104062597 None] attachment_update completed successfully.
Oct 29 21:16:12.574936 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b2e89139-7b33-4cd9-89ce-2d67f6e7eb3b tempest-VolumesBackupsAdminTest-356851268 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-29T21:16:12Z,data_timestamp=2022-10-29T21:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-98823620',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=8c315772-a3bf-492e-a9c5-df62021ef14d,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='64e7efc6ad0243d3aed9eaed70c2f583',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='c3b47c52daa24b928842a5ba03683624',volume_id=d4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc)
Oct 29 21:16:12.576125 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.backup.rpcapi [None req-b2e89139-7b33-4cd9-89ce-2d67f6e7eb3b tempest-VolumesBackupsAdminTest-356851268 None] continue_backup in rpcapi backup_id 8c315772-a3bf-492e-a9c5-df62021ef14d {{(pid=131780) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Oct 29 21:16:12.735592 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b2e89139-7b33-4cd9-89ce-2d67f6e7eb3b tempest-VolumesBackupsAdminTest-356851268 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:16:13.052579 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-672de776-3c2c-466e-8685-9d3290b2d96f req-3d275320-1fa3-4800-8794-66bd7ad95cf9 tempest-VolumesSnapshotTestJSON-1969201650 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:16:14.042345 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b2e89139-7b33-4cd9-89ce-2d67f6e7eb3b tempest-VolumesBackupsAdminTest-356851268 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.307s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:16:14.044183 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b2e89139-7b33-4cd9-89ce-2d67f6e7eb3b tempest-VolumesBackupsAdminTest-356851268 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'd4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:16:14.075657 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b2e89139-7b33-4cd9-89ce-2d67f6e7eb3b tempest-VolumesBackupsAdminTest-356851268 None] Initialize volume connection completed successfully.
Oct 29 21:16:14.182259 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-672de776-3c2c-466e-8685-9d3290b2d96f req-3d275320-1fa3-4800-8794-66bd7ad95cf9 tempest-VolumesSnapshotTestJSON-1969201650 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.130s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:16:14.184096 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-672de776-3c2c-466e-8685-9d3290b2d96f req-3d275320-1fa3-4800-8794-66bd7ad95cf9 tempest-VolumesSnapshotTestJSON-1969201650 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bde4424f-a811-49fc-b4f0-5d5fc9767766', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'bde4424f-a811-49fc-b4f0-5d5fc9767766', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:16:14.219446 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-672de776-3c2c-466e-8685-9d3290b2d96f req-3d275320-1fa3-4800-8794-66bd7ad95cf9 tempest-VolumesSnapshotTestJSON-1969201650 None] Connection info returned from driver {'name': 'volumes/volume-bde4424f-a811-49fc-b4f0-5d5fc9767766', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bde4424f-a811-49fc-b4f0-5d5fc9767766', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b563f75f-0a1f-4e2a-bc78-969259c05975'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:16:14.371159 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-672de776-3c2c-466e-8685-9d3290b2d96f req-3d275320-1fa3-4800-8794-66bd7ad95cf9 tempest-VolumesSnapshotTestJSON-1969201650 None] attachment_update completed successfully.
Oct 29 21:16:15.657935 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-1ef4352d-5f99-416b-8d37-703b18a7db29 req-994deed7-4311-497d-b99f-7e73b9cd83f1 tempest-AttachVolumeNegativeTest-2104062597 None] Terminate volume connection completed successfully.
Oct 29 21:16:15.658573 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-1ef4352d-5f99-416b-8d37-703b18a7db29 req-994deed7-4311-497d-b99f-7e73b9cd83f1 tempest-AttachVolumeNegativeTest-2104062597 None] Deleting attachment 8f225d8e-9935-4904-9cb5-45f671d680ba. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:16:16.612169 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fd8a717e-e25d-425b-b026-9c12652d6ed9 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:16.763068 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b2e89139-7b33-4cd9-89ce-2d67f6e7eb3b tempest-VolumesBackupsAdminTest-356851268 None] Terminate volume connection completed successfully.
Oct 29 21:16:16.792338 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b2e89139-7b33-4cd9-89ce-2d67f6e7eb3b tempest-VolumesBackupsAdminTest-356851268 None] Remove volume export completed successfully.
Oct 29 21:16:17.444948 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-fd8a717e-e25d-425b-b026-9c12652d6ed9 tempest-VolumesSnapshotTestJSON-1969201650 None] Create snapshot completed successfully
Oct 29 21:16:17.997562 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-98df2801-30f1-47c0-9ef9-ed865c82a87d tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:18.502532 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-98df2801-30f1-47c0-9ef9-ed865c82a87d tempest-VolumesSnapshotTestJSON-1969201650 None] Create snapshot completed successfully
Oct 29 21:16:19.033853 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-230bc2f0-d3ae-4a52-b96f-58ac3e363030 tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-31396f0a-a0cd-48f7-9eec-c7a6c57272b5-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:16:19.045488 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-230bc2f0-d3ae-4a52-b96f-58ac3e363030 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-31396f0a-a0cd-48f7-9eec-c7a6c57272b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:16:19.047584 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-230bc2f0-d3ae-4a52-b96f-58ac3e363030 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:20.250532 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:16:20.292335 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Flow 'volume_create_manager' (8e086826-e522-4b27-95a8-e23c192c392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:16:20.301555 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4920b054-4c6b-45da-aa68-ede59f7f7253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:20.323908 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4920b054-4c6b-45da-aa68-ede59f7f7253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:16:20Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_8c315772-a3bf-492e-a9c5-df62021ef14d',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=daf0831a-d16f-45c6-b673-b1220dae3c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64e7efc6ad0243d3aed9eaed70c2f583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:16:20Z,use_quota=True,user_id='c3b47c52daa24b928842a5ba03683624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:20.330414 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6096a4e-126a-4d77-95eb-841b376ae62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:20.335838 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6096a4e-126a-4d77-95eb-841b376ae62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:20.341844 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f760fd-7c50-4ba0-8557-c3bff401ee18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:20.349274 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f760fd-7c50-4ba0-8557-c3bff401ee18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daf0831a-d16f-45c6-b673-b1220dae3c0e', 'volume_name': 'volume-daf0831a-d16f-45c6-b673-b1220dae3c0e', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:20.354855 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45febd8-48b2-4c34-84d5-d5b3d2ccd223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:20.359627 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45febd8-48b2-4c34-84d5-d5b3d2ccd223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:20.364869 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a74f36e-e282-4b20-9a69-3a9c98d864a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:20.366924 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Volume daf0831a-d16f-45c6-b673-b1220dae3c0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daf0831a-d16f-45c6-b673-b1220dae3c0e', 'volume_size': 1}
Oct 29 21:16:20.367573 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] creating volume 'volume-daf0831a-d16f-45c6-b673-b1220dae3c0e' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:16:20.369282 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:20.514692 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:16:20.515053 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:16:20.518831 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a74f36e-e282-4b20-9a69-3a9c98d864a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf0831a-d16f-45c6-b673-b1220dae3c0e', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:20.526400 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65d0829-123f-4e6b-bcb6-4d0260cee52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:20.548729 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Volume volume-daf0831a-d16f-45c6-b673-b1220dae3c0e (daf0831a-d16f-45c6-b673-b1220dae3c0e): created successfully
Oct 29 21:16:20.552242 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65d0829-123f-4e6b-bcb6-4d0260cee52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:20.562967 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Flow 'volume_create_manager' (8e086826-e522-4b27-95a8-e23c192c392b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:16:20.578067 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Created volume successfully.
Oct 29 21:16:21.460913 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:16:22.909067 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.448s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:16:22.910208 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-daf0831a-d16f-45c6-b673-b1220dae3c0e', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'daf0831a-d16f-45c6-b673-b1220dae3c0e', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:16:22.949069 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Initialize volume connection completed successfully.
Oct 29 21:16:24.731606 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Terminate volume connection completed successfully.
Oct 29 21:16:24.757252 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b62376bd-0495-4a34-aaf6-9fc3b5a73aae tempest-VolumesBackupsAdminTest-356851268 None] Remove volume export completed successfully.
Oct 29 21:16:25.691063 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-700d98d8-e524-470e-91c7-15e416a81f24 tempest-VolumesBackupsAdminTest-356851268 None] Acquiring lock "cinder-daf0831a-d16f-45c6-b673-b1220dae3c0e-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:16:25.703504 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-700d98d8-e524-470e-91c7-15e416a81f24 tempest-VolumesBackupsAdminTest-356851268 None] Lock "cinder-daf0831a-d16f-45c6-b673-b1220dae3c0e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:16:25.765033 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-700d98d8-e524-470e-91c7-15e416a81f24 tempest-VolumesBackupsAdminTest-356851268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:26.182853 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-700d98d8-e524-470e-91c7-15e416a81f24 tempest-VolumesBackupsAdminTest-356851268 None] Volume volume-daf0831a-d16f-45c6-b673-b1220dae3c0e is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:16:26.212717 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-700d98d8-e524-470e-91c7-15e416a81f24 tempest-VolumesBackupsAdminTest-356851268 None] deleting rbd volume volume-daf0831a-d16f-45c6-b673-b1220dae3c0e {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:16:26.588529 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-700d98d8-e524-470e-91c7-15e416a81f24 tempest-VolumesBackupsAdminTest-356851268 None] Created reservations ['a770dc19-c16d-4817-9657-649560695e22', '00275f49-5b05-464f-bbc8-b0110753ce2b', 'decd7b70-1b45-4fdf-a3ea-591bb58c6b59', '0aedd83a-678c-44df-9453-a7ec74739429'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:16:26.680227 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-700d98d8-e524-470e-91c7-15e416a81f24 tempest-VolumesBackupsAdminTest-356851268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:26.725804 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-700d98d8-e524-470e-91c7-15e416a81f24 tempest-VolumesBackupsAdminTest-356851268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:26.775065 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-700d98d8-e524-470e-91c7-15e416a81f24 tempest-VolumesBackupsAdminTest-356851268 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:16:26.783163 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-700d98d8-e524-470e-91c7-15e416a81f24 tempest-VolumesBackupsAdminTest-356851268 None] Deleted volume successfully.
Oct 29 21:16:26.831793 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-700d98d8-e524-470e-91c7-15e416a81f24 tempest-VolumesBackupsAdminTest-356851268 None] Lock "cinder-daf0831a-d16f-45c6-b673-b1220dae3c0e-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:16:29.669246 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:16:29.700603 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Flow 'volume_create_manager' (717d225e-5306-4e39-bd58-303fbba78443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:16:29.714204 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dece17e7-9118-429f-bc59-82cde5e976f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:29.741673 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dece17e7-9118-429f-bc59-82cde5e976f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-907305559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2871845f-504c-4ccf-b0c1-f3ae146fbeeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64e7efc6ad0243d3aed9eaed70c2f583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:16:30Z,use_quota=True,user_id='c3b47c52daa24b928842a5ba03683624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:29.747280 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58511d0-ec48-41e0-834f-7e94130ec6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:29.751412 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58511d0-ec48-41e0-834f-7e94130ec6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:29.757876 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2f3b58-65c0-4ad7-8bf0-0259e83693e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:29.766559 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2f3b58-65c0-4ad7-8bf0-0259e83693e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2871845f-504c-4ccf-b0c1-f3ae146fbeeb', 'volume_name': 'volume-2871845f-504c-4ccf-b0c1-f3ae146fbeeb', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:29.772819 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0863e650-77c5-461e-981d-7a02823a41c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:29.777300 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0863e650-77c5-461e-981d-7a02823a41c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:29.783314 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc8bece-db27-4c46-a3fb-925eed667b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:29.786076 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Volume 2871845f-504c-4ccf-b0c1-f3ae146fbeeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2871845f-504c-4ccf-b0c1-f3ae146fbeeb', 'volume_size': 1}
Oct 29 21:16:29.788098 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] creating volume 'volume-2871845f-504c-4ccf-b0c1-f3ae146fbeeb' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:16:29.789328 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:29.911307 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:16:29.912880 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:16:29.919709 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc8bece-db27-4c46-a3fb-925eed667b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2871845f-504c-4ccf-b0c1-f3ae146fbeeb', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:29.937080 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dc6d5b-8415-445f-b62e-e0c939a3b169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:29.972533 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Volume volume-2871845f-504c-4ccf-b0c1-f3ae146fbeeb (2871845f-504c-4ccf-b0c1-f3ae146fbeeb): created successfully
Oct 29 21:16:29.980156 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dc6d5b-8415-445f-b62e-e0c939a3b169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:29.991463 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Flow 'volume_create_manager' (717d225e-5306-4e39-bd58-303fbba78443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:16:30.018986 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-8c3cea63-6189-4219-8bdf-589ceb50a3a3 tempest-VolumesBackupsAdminTest-356851268 None] Created volume successfully.
Oct 29 21:16:30.939274 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=75,cinder:UPDATE=21,cinder:DELETE=3,cinder:INSERT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:16:30.949062 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-97fef943-ca8c-4607-a95d-9fb53bd654cf tempest-VolumesBackupsAdminTest-356851268 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-29T21:16:30Z,data_timestamp=2022-10-29T21:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1490993522',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=b4eaa38a-f9a5-4d2d-aff3-cca7c56c3f74,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='64e7efc6ad0243d3aed9eaed70c2f583',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='c3b47c52daa24b928842a5ba03683624',volume_id=2871845f-504c-4ccf-b0c1-f3ae146fbeeb)
Oct 29 21:16:30.949840 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.backup.rpcapi [None req-97fef943-ca8c-4607-a95d-9fb53bd654cf tempest-VolumesBackupsAdminTest-356851268 None] continue_backup in rpcapi backup_id b4eaa38a-f9a5-4d2d-aff3-cca7c56c3f74 {{(pid=131780) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Oct 29 21:16:31.113496 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-97fef943-ca8c-4607-a95d-9fb53bd654cf tempest-VolumesBackupsAdminTest-356851268 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:16:32.215705 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-97fef943-ca8c-4607-a95d-9fb53bd654cf tempest-VolumesBackupsAdminTest-356851268 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.102s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:16:32.217995 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-97fef943-ca8c-4607-a95d-9fb53bd654cf tempest-VolumesBackupsAdminTest-356851268 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2871845f-504c-4ccf-b0c1-f3ae146fbeeb', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '2871845f-504c-4ccf-b0c1-f3ae146fbeeb', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:16:32.239010 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-97fef943-ca8c-4607-a95d-9fb53bd654cf tempest-VolumesBackupsAdminTest-356851268 None] Initialize volume connection completed successfully.
Oct 29 21:16:33.974989 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-97fef943-ca8c-4607-a95d-9fb53bd654cf tempest-VolumesBackupsAdminTest-356851268 None] Terminate volume connection completed successfully.
Oct 29 21:16:34.011142 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-97fef943-ca8c-4607-a95d-9fb53bd654cf tempest-VolumesBackupsAdminTest-356851268 None] Remove volume export completed successfully.
Oct 29 21:16:37.762896 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-0e6f64e5-5200-47bf-a9e6-963588a8b71f tempest-VolumesBackupsAdminTest-356851268 None] Acquiring lock "cinder-2871845f-504c-4ccf-b0c1-f3ae146fbeeb-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:16:37.782767 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-0e6f64e5-5200-47bf-a9e6-963588a8b71f tempest-VolumesBackupsAdminTest-356851268 None] Lock "cinder-2871845f-504c-4ccf-b0c1-f3ae146fbeeb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:16:37.824107 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0e6f64e5-5200-47bf-a9e6-963588a8b71f tempest-VolumesBackupsAdminTest-356851268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:38.784277 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0e6f64e5-5200-47bf-a9e6-963588a8b71f tempest-VolumesBackupsAdminTest-356851268 None] Volume volume-2871845f-504c-4ccf-b0c1-f3ae146fbeeb is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:16:38.797109 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0e6f64e5-5200-47bf-a9e6-963588a8b71f tempest-VolumesBackupsAdminTest-356851268 None] deleting rbd volume volume-2871845f-504c-4ccf-b0c1-f3ae146fbeeb {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:16:38.804287 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-68799220-bfd1-4bff-ad84-a48b2cde0f31 tempest-AttachVolumeShelveTestJSON-1635390820 None] Acquiring lock "cinder-08642dd9-e507-4301-87f6-062a368e0852-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:16:38.817744 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-68799220-bfd1-4bff-ad84-a48b2cde0f31 tempest-AttachVolumeShelveTestJSON-1635390820 None] Lock "cinder-08642dd9-e507-4301-87f6-062a368e0852-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:16:38.874995 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=79,cinder:UPDATE=16,cinder:DELETE=2,cinder:INSERT=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:16:38.880013 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-68799220-bfd1-4bff-ad84-a48b2cde0f31 tempest-AttachVolumeShelveTestJSON-1635390820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:38.962164 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-68799220-bfd1-4bff-ad84-a48b2cde0f31 tempest-AttachVolumeShelveTestJSON-1635390820 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:16:38.962706 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-68799220-bfd1-4bff-ad84-a48b2cde0f31 tempest-AttachVolumeShelveTestJSON-1635390820 None] Volume volume-08642dd9-e507-4301-87f6-062a368e0852 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:16:38.967189 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-68799220-bfd1-4bff-ad84-a48b2cde0f31 tempest-AttachVolumeShelveTestJSON-1635390820 None] deleting rbd volume volume-08642dd9-e507-4301-87f6-062a368e0852 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:16:39.091842 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-0e6f64e5-5200-47bf-a9e6-963588a8b71f tempest-VolumesBackupsAdminTest-356851268 None] Created reservations ['cc4225fe-487a-4786-8900-9dc1cfe81eea', '4431f573-e993-4b83-b0ae-ca4f6bcccfdc', '7a2b8bec-a01c-4570-99e5-f4fc1f20a0f5', 'e43efb06-7a90-4bbb-ab27-75289de9a59b'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:16:39.176908 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0e6f64e5-5200-47bf-a9e6-963588a8b71f tempest-VolumesBackupsAdminTest-356851268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:39.275751 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0e6f64e5-5200-47bf-a9e6-963588a8b71f tempest-VolumesBackupsAdminTest-356851268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:39.372261 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-0e6f64e5-5200-47bf-a9e6-963588a8b71f tempest-VolumesBackupsAdminTest-356851268 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:16:39.379289 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-0e6f64e5-5200-47bf-a9e6-963588a8b71f tempest-VolumesBackupsAdminTest-356851268 None] Deleted volume successfully.
Oct 29 21:16:39.417615 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-0e6f64e5-5200-47bf-a9e6-963588a8b71f tempest-VolumesBackupsAdminTest-356851268 None] Lock "cinder-2871845f-504c-4ccf-b0c1-f3ae146fbeeb-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:16:39.467142 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-68799220-bfd1-4bff-ad84-a48b2cde0f31 tempest-AttachVolumeShelveTestJSON-1635390820 None] Created reservations ['c7bb3d7f-64c7-477f-9ed5-9306f7569108', 'f7eae231-623a-4ad1-9eb5-a5b7cf960cda', 'b5406607-b9c0-49a0-bd3f-35f92abb6152', '35b59a52-182d-40af-bd90-db51e8ca2a81'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:16:39.532843 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-68799220-bfd1-4bff-ad84-a48b2cde0f31 tempest-AttachVolumeShelveTestJSON-1635390820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:39.572038 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-68799220-bfd1-4bff-ad84-a48b2cde0f31 tempest-AttachVolumeShelveTestJSON-1635390820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:39.649380 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-68799220-bfd1-4bff-ad84-a48b2cde0f31 tempest-AttachVolumeShelveTestJSON-1635390820 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:16:39.654538 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-68799220-bfd1-4bff-ad84-a48b2cde0f31 tempest-AttachVolumeShelveTestJSON-1635390820 None] Deleted volume successfully.
Oct 29 21:16:39.668903 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-68799220-bfd1-4bff-ad84-a48b2cde0f31 tempest-AttachVolumeShelveTestJSON-1635390820 None] Lock "cinder-08642dd9-e507-4301-87f6-062a368e0852-delete_volume" released by "delete_volume" :: held 0.851s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:16:40.039704 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e730266a-a088-4812-83d1-b76bfe730483 tempest-VolumesBackupsAdminTest-356851268 None] Acquiring lock "cinder-d4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:16:40.053126 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e730266a-a088-4812-83d1-b76bfe730483 tempest-VolumesBackupsAdminTest-356851268 None] Lock "cinder-d4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:16:40.096719 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e730266a-a088-4812-83d1-b76bfe730483 tempest-VolumesBackupsAdminTest-356851268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:40.852500 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e730266a-a088-4812-83d1-b76bfe730483 tempest-VolumesBackupsAdminTest-356851268 None] Volume volume-d4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:16:40.900133 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e730266a-a088-4812-83d1-b76bfe730483 tempest-VolumesBackupsAdminTest-356851268 None] deleting rbd volume volume-d4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:16:40.906660 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f182d038-1cf9-434a-839b-441385b67e92 tempest-AttachVolumeShelveTestJSON-1635390820 None] Acquiring lock "cinder-e7628d78-193e-456e-ab22-7607b628008d-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:16:40.930373 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f182d038-1cf9-434a-839b-441385b67e92 tempest-AttachVolumeShelveTestJSON-1635390820 None] Lock "cinder-e7628d78-193e-456e-ab22-7607b628008d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:16:41.020468 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f182d038-1cf9-434a-839b-441385b67e92 tempest-AttachVolumeShelveTestJSON-1635390820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:41.121233 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f182d038-1cf9-434a-839b-441385b67e92 tempest-AttachVolumeShelveTestJSON-1635390820 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:16:41.124565 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f182d038-1cf9-434a-839b-441385b67e92 tempest-AttachVolumeShelveTestJSON-1635390820 None] Volume volume-e7628d78-193e-456e-ab22-7607b628008d is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:16:41.135895 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f182d038-1cf9-434a-839b-441385b67e92 tempest-AttachVolumeShelveTestJSON-1635390820 None] deleting rbd volume volume-e7628d78-193e-456e-ab22-7607b628008d {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:16:41.243456 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-e730266a-a088-4812-83d1-b76bfe730483 tempest-VolumesBackupsAdminTest-356851268 None] Created reservations ['2f98a148-5cd2-482c-8647-3df57f3b3af4', 'd0fe1ac9-5d81-4fb8-a3d7-dabf64d54c0b', 'b42af079-77cb-429a-8d6b-f378872ceab0', '2971503b-4cf5-4fa8-aed7-a2ae45e9b11c'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:16:41.312559 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e730266a-a088-4812-83d1-b76bfe730483 tempest-VolumesBackupsAdminTest-356851268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:41.384406 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e730266a-a088-4812-83d1-b76bfe730483 tempest-VolumesBackupsAdminTest-356851268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:41.452642 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-e730266a-a088-4812-83d1-b76bfe730483 tempest-VolumesBackupsAdminTest-356851268 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:16:41.479721 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-e730266a-a088-4812-83d1-b76bfe730483 tempest-VolumesBackupsAdminTest-356851268 None] Deleted volume successfully.
Oct 29 21:16:41.510059 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e730266a-a088-4812-83d1-b76bfe730483 tempest-VolumesBackupsAdminTest-356851268 None] Lock "cinder-d4f0f809-b21b-4be2-8b0c-9cb7dac9cbbc-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:16:41.525081 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-f182d038-1cf9-434a-839b-441385b67e92 tempest-AttachVolumeShelveTestJSON-1635390820 None] Created reservations ['4849a8d6-b1df-4467-8846-369227a17ed1', '5a5595d1-440f-4e9e-8e4f-2b00a88d01d3', '9bbe525c-9ac0-4cb2-91ff-fe23a18d489f', '32b589d0-c7be-4f9d-b0a7-915a0c462ecf'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:16:41.577283 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=57,cinder:UPDATE=37,cinder:INSERT=5,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:16:41.596094 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f182d038-1cf9-434a-839b-441385b67e92 tempest-AttachVolumeShelveTestJSON-1635390820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:41.640633 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f182d038-1cf9-434a-839b-441385b67e92 tempest-AttachVolumeShelveTestJSON-1635390820 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:41.702385 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-f182d038-1cf9-434a-839b-441385b67e92 tempest-AttachVolumeShelveTestJSON-1635390820 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:16:41.711464 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f182d038-1cf9-434a-839b-441385b67e92 tempest-AttachVolumeShelveTestJSON-1635390820 None] Deleted volume successfully.
Oct 29 21:16:41.734093 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f182d038-1cf9-434a-839b-441385b67e92 tempest-AttachVolumeShelveTestJSON-1635390820 None] Lock "cinder-e7628d78-193e-456e-ab22-7607b628008d-delete_volume" released by "delete_volume" :: held 0.804s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:16:49.320459 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-230bc2f0-d3ae-4a52-b96f-58ac3e363030 tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['b77e8cc8-3917-4b73-9838-d80b8434840e', '60fdacd6-588c-4e0e-be66-f70181b9258c', '3939609a-b896-41cf-a45a-2ec45ff4d61e', 'efe6a9e3-3404-4619-93f4-c897deab36c1'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:16:49.370320 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-230bc2f0-d3ae-4a52-b96f-58ac3e363030 tempest-VolumesSnapshotTestJSON-1969201650 None] Delete snapshot completed successfully.
Oct 29 21:16:49.377053 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-230bc2f0-d3ae-4a52-b96f-58ac3e363030 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-31396f0a-a0cd-48f7-9eec-c7a6c57272b5-delete_snapshot" released by "delete_snapshot" :: held 30.332s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:16:49.443841 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:16:49.471587 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Flow 'volume_create_manager' (82f83a5e-36f6-4a80-8c5d-68d1b1005c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:16:49.480975 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a51129-0808-4722-842b-4522c4fe7f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:49.499473 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a51129-0808-4722-842b-4522c4fe7f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-937909992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a8cbe8d3-34bb-4c13-afa9-f67aeb021217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d823b5b6e143b1893ac4001ecee8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:16:49Z,use_quota=True,user_id='d3f40972099f47318f7c17c7e697054d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:49.506981 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e429a8-0233-42b8-99ab-42a55e42fb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:49.512229 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e429a8-0233-42b8-99ab-42a55e42fb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:49.517537 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e16b995-8ca1-42cb-b410-d1f8006cca4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:49.522873 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e16b995-8ca1-42cb-b410-d1f8006cca4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8cbe8d3-34bb-4c13-afa9-f67aeb021217', 'volume_name': 'volume-a8cbe8d3-34bb-4c13-afa9-f67aeb021217', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:49.528897 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223a06c4-53f4-4ed3-b9eb-2a664f5bc399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:49.550333 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223a06c4-53f4-4ed3-b9eb-2a664f5bc399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:49.555934 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04eb987a-beaa-4e14-8baa-9022d9a9a967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:49.564353 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Volume a8cbe8d3-34bb-4c13-afa9-f67aeb021217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8cbe8d3-34bb-4c13-afa9-f67aeb021217', 'volume_size': 1}
Oct 29 21:16:49.564765 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] creating volume 'volume-a8cbe8d3-34bb-4c13-afa9-f67aeb021217' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:16:49.566442 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:49.625531 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-25dbe061-7a9f-48e9-b86a-a4ebea0ef6bd tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-feb7b108-e848-4c8c-a365-418339579759-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:16:49.645388 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-25dbe061-7a9f-48e9-b86a-a4ebea0ef6bd tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-feb7b108-e848-4c8c-a365-418339579759-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:16:49.647745 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-25dbe061-7a9f-48e9-b86a-a4ebea0ef6bd tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:49.733769 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:16:49.734230 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:16:49.741758 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04eb987a-beaa-4e14-8baa-9022d9a9a967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8cbe8d3-34bb-4c13-afa9-f67aeb021217', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:49.749156 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99ec0bc-d1e5-45d6-96d9-a4630179c284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:49.764923 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Volume volume-a8cbe8d3-34bb-4c13-afa9-f67aeb021217 (a8cbe8d3-34bb-4c13-afa9-f67aeb021217): created successfully
Oct 29 21:16:49.772502 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99ec0bc-d1e5-45d6-96d9-a4630179c284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:49.780983 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Flow 'volume_create_manager' (82f83a5e-36f6-4a80-8c5d-68d1b1005c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:16:49.795455 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-ab8e8aa1-c1c1-4361-8a87-d15528d0e96d tempest-VolumesBackupsTest-782410826 None] Created volume successfully.
Oct 29 21:16:53.195704 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=50,cinder:INSERT=11,cinder:UPDATE=36,cinder:DELETE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:16:54.919362 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:16:54.951004 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Flow 'volume_create_manager' (d426c744-e5ab-4ef7-8c35-53f63f7f8509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:16:54.958291 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5bc429-b5ac-4912-9b27-ccd501b927c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:54.976022 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5bc429-b5ac-4912-9b27-ccd501b927c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1361836934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b0c7b023-ca52-40e5-8beb-7f1b5954c3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='622a4fd091fd467d9d07c1e8bfbd0d1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:16:55Z,use_quota=True,user_id='d4b9a1b71d0640aeb2deb340ea310f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:54.981999 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a825aca9-a076-4015-b8f5-83946ca79f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:54.986471 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a825aca9-a076-4015-b8f5-83946ca79f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:54.994205 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4476f112-51e8-41a4-9ad5-31e387387b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:54.999957 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4476f112-51e8-41a4-9ad5-31e387387b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0c7b023-ca52-40e5-8beb-7f1b5954c3e8', 'volume_name': 'volume-b0c7b023-ca52-40e5-8beb-7f1b5954c3e8', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:55.006163 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29060a2e-710c-47a1-b3e1-87cf8c4b4f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:55.011074 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29060a2e-710c-47a1-b3e1-87cf8c4b4f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:55.016194 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5011c645-b650-4d86-96ec-4b0fee450b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:55.017589 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Volume b0c7b023-ca52-40e5-8beb-7f1b5954c3e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0c7b023-ca52-40e5-8beb-7f1b5954c3e8', 'volume_size': 1}
Oct 29 21:16:55.018155 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] creating volume 'volume-b0c7b023-ca52-40e5-8beb-7f1b5954c3e8' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:16:55.019133 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:55.118056 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:16:55.118831 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:16:55.122701 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5011c645-b650-4d86-96ec-4b0fee450b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0c7b023-ca52-40e5-8beb-7f1b5954c3e8', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:55.135403 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f5371d-f5da-4014-b5f6-fb79af793b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:16:55.148973 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Volume volume-b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 (b0c7b023-ca52-40e5-8beb-7f1b5954c3e8): created successfully
Oct 29 21:16:55.160265 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f5371d-f5da-4014-b5f6-fb79af793b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:16:55.166695 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Flow 'volume_create_manager' (d426c744-e5ab-4ef7-8c35-53f63f7f8509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:16:55.179551 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-acda1372-6d56-47da-b340-3fb555dfaa20 req-b19899d9-c5de-4d5a-a320-1bb5ed30a664 tempest-VolumesSnapshotsTestJSON-1519697196 None] Created volume successfully.
Oct 29 21:16:56.744512 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-955df4a9-352d-477c-8fc7-c99eb79e940b req-0922df4c-3946-415b-aa6e-b6a0eef6fee2 tempest-VolumesSnapshotsTestJSON-1519697196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:57.507760 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-955df4a9-352d-477c-8fc7-c99eb79e940b req-0922df4c-3946-415b-aa6e-b6a0eef6fee2 tempest-VolumesSnapshotsTestJSON-1519697196 None] Create snapshot completed successfully
Oct 29 21:16:57.969821 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-00ef6547-48bb-4938-ac8c-e0f17585bc32 req-c56bbd28-f170-4e3d-8efd-65a82a338725 tempest-VolumesSnapshotsTestJSON-1519697196 None] Acquiring lock "cinder-890db0bc-6ee4-41b2-84c6-cc4cdd37e174-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:16:57.994646 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-00ef6547-48bb-4938-ac8c-e0f17585bc32 req-c56bbd28-f170-4e3d-8efd-65a82a338725 tempest-VolumesSnapshotsTestJSON-1519697196 None] Lock "cinder-890db0bc-6ee4-41b2-84c6-cc4cdd37e174-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:16:57.996170 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-00ef6547-48bb-4938-ac8c-e0f17585bc32 req-c56bbd28-f170-4e3d-8efd-65a82a338725 tempest-VolumesSnapshotsTestJSON-1519697196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:58.576508 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [req-00ef6547-48bb-4938-ac8c-e0f17585bc32 req-c56bbd28-f170-4e3d-8efd-65a82a338725 tempest-VolumesSnapshotsTestJSON-1519697196 None] Created reservations ['aa54b8cc-7954-48ee-988b-cc677be67309', 'f110131f-f5c1-4cdf-83bc-285b6880d7a0', 'ddc5341d-1b1a-450b-a596-c2b372bc5801', '5623e895-8f13-48d6-8aa7-cd8a539cf810'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:16:58.638511 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-00ef6547-48bb-4938-ac8c-e0f17585bc32 req-c56bbd28-f170-4e3d-8efd-65a82a338725 tempest-VolumesSnapshotsTestJSON-1519697196 None] Delete snapshot completed successfully.
Oct 29 21:16:58.643868 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-00ef6547-48bb-4938-ac8c-e0f17585bc32 req-c56bbd28-f170-4e3d-8efd-65a82a338725 tempest-VolumesSnapshotsTestJSON-1519697196 None] Lock "cinder-890db0bc-6ee4-41b2-84c6-cc4cdd37e174-delete_snapshot" released by "delete_snapshot" :: held 0.649s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:16:59.172028 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-3ed08fd5-a9be-4ddb-88cc-1496f2120ff3 req-67a652a7-b149-44c3-9ad1-dc4abe289de0 tempest-VolumesSnapshotsTestJSON-1519697196 None] Acquiring lock "cinder-b0c7b023-ca52-40e5-8beb-7f1b5954c3e8-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:16:59.190011 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-3ed08fd5-a9be-4ddb-88cc-1496f2120ff3 req-67a652a7-b149-44c3-9ad1-dc4abe289de0 tempest-VolumesSnapshotsTestJSON-1519697196 None] Lock "cinder-b0c7b023-ca52-40e5-8beb-7f1b5954c3e8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:16:59.250915 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-3ed08fd5-a9be-4ddb-88cc-1496f2120ff3 req-67a652a7-b149-44c3-9ad1-dc4abe289de0 tempest-VolumesSnapshotsTestJSON-1519697196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:59.309198 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-3ed08fd5-a9be-4ddb-88cc-1496f2120ff3 req-67a652a7-b149-44c3-9ad1-dc4abe289de0 tempest-VolumesSnapshotsTestJSON-1519697196 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:16:59.309675 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-3ed08fd5-a9be-4ddb-88cc-1496f2120ff3 req-67a652a7-b149-44c3-9ad1-dc4abe289de0 tempest-VolumesSnapshotsTestJSON-1519697196 None] Volume volume-b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:16:59.313902 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-3ed08fd5-a9be-4ddb-88cc-1496f2120ff3 req-67a652a7-b149-44c3-9ad1-dc4abe289de0 tempest-VolumesSnapshotsTestJSON-1519697196 None] deleting rbd volume volume-b0c7b023-ca52-40e5-8beb-7f1b5954c3e8 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:16:59.566341 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [req-3ed08fd5-a9be-4ddb-88cc-1496f2120ff3 req-67a652a7-b149-44c3-9ad1-dc4abe289de0 tempest-VolumesSnapshotsTestJSON-1519697196 None] Created reservations ['ab28dfe0-f967-4293-baae-f5777eaa38d2', '56044d90-f943-4357-9356-a81e7ef90fc5', '081cb3d8-836d-42d4-b9cc-a3febfdef9d5', 'ab6ef5d3-f396-4885-902c-0d433812e305'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:16:59.646059 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-3ed08fd5-a9be-4ddb-88cc-1496f2120ff3 req-67a652a7-b149-44c3-9ad1-dc4abe289de0 tempest-VolumesSnapshotsTestJSON-1519697196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:59.703454 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-3ed08fd5-a9be-4ddb-88cc-1496f2120ff3 req-67a652a7-b149-44c3-9ad1-dc4abe289de0 tempest-VolumesSnapshotsTestJSON-1519697196 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:16:59.753587 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [req-3ed08fd5-a9be-4ddb-88cc-1496f2120ff3 req-67a652a7-b149-44c3-9ad1-dc4abe289de0 tempest-VolumesSnapshotsTestJSON-1519697196 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:16:59.758800 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-3ed08fd5-a9be-4ddb-88cc-1496f2120ff3 req-67a652a7-b149-44c3-9ad1-dc4abe289de0 tempest-VolumesSnapshotsTestJSON-1519697196 None] Deleted volume successfully.
Oct 29 21:16:59.773799 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-3ed08fd5-a9be-4ddb-88cc-1496f2120ff3 req-67a652a7-b149-44c3-9ad1-dc4abe289de0 tempest-VolumesSnapshotsTestJSON-1519697196 None] Lock "cinder-b0c7b023-ca52-40e5-8beb-7f1b5954c3e8-delete_volume" released by "delete_volume" :: held 0.584s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:17:01.388203 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:17:01.389751 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:01.454833 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:01.532259 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:17:08.041216 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-0974ee80-1b80-4c17-9097-76c76139fb9a req-597d2446-99cc-4bfa-b6ae-5cf94b8c4a64 tempest-VolumesBackupsTest-782410826 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:17:09.822144 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-0974ee80-1b80-4c17-9097-76c76139fb9a req-597d2446-99cc-4bfa-b6ae-5cf94b8c4a64 tempest-VolumesBackupsTest-782410826 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.780s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:17:09.822955 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-0974ee80-1b80-4c17-9097-76c76139fb9a req-597d2446-99cc-4bfa-b6ae-5cf94b8c4a64 tempest-VolumesBackupsTest-782410826 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a8cbe8d3-34bb-4c13-afa9-f67aeb021217', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'a8cbe8d3-34bb-4c13-afa9-f67aeb021217', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:17:09.895170 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-0974ee80-1b80-4c17-9097-76c76139fb9a req-597d2446-99cc-4bfa-b6ae-5cf94b8c4a64 tempest-VolumesBackupsTest-782410826 None] Connection info returned from driver {'name': 'volumes/volume-a8cbe8d3-34bb-4c13-afa9-f67aeb021217', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a8cbe8d3-34bb-4c13-afa9-f67aeb021217', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ee824794-d2c8-48b2-b244-bdd8c45f82f2'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:17:10.011270 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-0974ee80-1b80-4c17-9097-76c76139fb9a req-597d2446-99cc-4bfa-b6ae-5cf94b8c4a64 tempest-VolumesBackupsTest-782410826 None] attachment_update completed successfully.
Oct 29 21:17:12.718683 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=61,cinder:UPDATE=20,cinder:INSERT=9,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:17:12.754627 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1f49358f-5601-48d1-9e5d-636723d2972b tempest-VolumesBackupsTest-782410826 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-29T21:17:12Z,data_timestamp=2022-10-29T21:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-571346760',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=6c24aebe-fc61-4abb-8232-74adc950ed64,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='99d823b5b6e143b1893ac4001ecee8f5',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d3f40972099f47318f7c17c7e697054d',volume_id=a8cbe8d3-34bb-4c13-afa9-f67aeb021217)
Oct 29 21:17:12.756801 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.backup.rpcapi [None req-1f49358f-5601-48d1-9e5d-636723d2972b tempest-VolumesBackupsTest-782410826 None] continue_backup in rpcapi backup_id 6c24aebe-fc61-4abb-8232-74adc950ed64 {{(pid=131780) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Oct 29 21:17:12.997735 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-1f49358f-5601-48d1-9e5d-636723d2972b tempest-VolumesBackupsTest-782410826 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:17:14.234283 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-1f49358f-5601-48d1-9e5d-636723d2972b tempest-VolumesBackupsTest-782410826 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.236s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:17:14.235588 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1f49358f-5601-48d1-9e5d-636723d2972b tempest-VolumesBackupsTest-782410826 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a8cbe8d3-34bb-4c13-afa9-f67aeb021217', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'a8cbe8d3-34bb-4c13-afa9-f67aeb021217', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:17:14.262545 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1f49358f-5601-48d1-9e5d-636723d2972b tempest-VolumesBackupsTest-782410826 None] Initialize volume connection completed successfully.
Oct 29 21:17:16.117234 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1f49358f-5601-48d1-9e5d-636723d2972b tempest-VolumesBackupsTest-782410826 None] Terminate volume connection completed successfully.
Oct 29 21:17:16.152291 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1f49358f-5601-48d1-9e5d-636723d2972b tempest-VolumesBackupsTest-782410826 None] Remove volume export completed successfully.
Oct 29 21:17:19.392238 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-aeddfbd2-653b-4daa-b9c2-880ddf79235b tempest-GroupsV320Test-1629055929 None] Group tempest-GroupsV320Test-Group-1345663414: creating
Oct 29 21:17:19.434237 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-aeddfbd2-653b-4daa-b9c2-880ddf79235b tempest-GroupsV320Test-1629055929 None] Group tempest-GroupsV320Test-Group-1345663414: created successfully
Oct 29 21:17:19.459940 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-aeddfbd2-653b-4daa-b9c2-880ddf79235b tempest-GroupsV320Test-1629055929 None] Create group completed successfully.
Oct 29 21:17:19.932155 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-25dbe061-7a9f-48e9-b86a-a4ebea0ef6bd tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['41394882-fa9b-4fa9-8c12-faa8326f674f', '892a3a57-459b-4609-b870-d05f7e72c664', 'd2a058df-a355-4c9f-9357-1fedc31a90c2', '28538eac-519a-408e-a935-888ccc0201c7'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:17:19.983205 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-25dbe061-7a9f-48e9-b86a-a4ebea0ef6bd tempest-VolumesSnapshotTestJSON-1969201650 None] Delete snapshot completed successfully.
Oct 29 21:17:19.990599 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-25dbe061-7a9f-48e9-b86a-a4ebea0ef6bd tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-feb7b108-e848-4c8c-a365-418339579759-delete_snapshot" released by "delete_snapshot" :: held 30.345s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:17:20.321099 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c998d384-5d38-460c-adae-27fbbd7be8b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-a542b13b-c010-45d6-ab5c-527a24711598-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:17:20.331066 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c998d384-5d38-460c-adae-27fbbd7be8b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-a542b13b-c010-45d6-ab5c-527a24711598-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:17:20.344950 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c998d384-5d38-460c-adae-27fbbd7be8b2 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:20.508636 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-61d4c3a3-10ff-4bec-9984-d96effa516da req-78efd6f2-3a8d-4918-ab38-fed9aedde2c3 tempest-VolumesBackupsTest-782410826 None] Terminate volume connection completed successfully.
Oct 29 21:17:20.509280 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-61d4c3a3-10ff-4bec-9984-d96effa516da req-78efd6f2-3a8d-4918-ab38-fed9aedde2c3 tempest-VolumesBackupsTest-782410826 None] Deleting attachment ee824794-d2c8-48b2-b244-bdd8c45f82f2. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:17:21.460497 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=64,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:17:21.555327 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-1b1deb8f-5fe4-455b-b06b-0aa5ff7becad tempest-GroupsV320Test-1629055929 None] Created reservations ['fcaa7242-07be-43b5-b614-58845490e78a'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:17:21.609780 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1b1deb8f-5fe4-455b-b06b-0aa5ff7becad tempest-GroupsV320Test-1629055929 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:21.672270 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1b1deb8f-5fe4-455b-b06b-0aa5ff7becad tempest-GroupsV320Test-1629055929 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:21.748301 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1b1deb8f-5fe4-455b-b06b-0aa5ff7becad tempest-GroupsV320Test-1629055929 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:17:21.767988 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1b1deb8f-5fe4-455b-b06b-0aa5ff7becad tempest-GroupsV320Test-1629055929 None] Delete group completed successfully.
Oct 29 21:17:25.471069 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-34fd7db0-6535-47c8-8b26-8bbb6732775f tempest-VolumesBackupsTest-782410826 None] Acquiring lock "cinder-a8cbe8d3-34bb-4c13-afa9-f67aeb021217-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:17:25.496053 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-34fd7db0-6535-47c8-8b26-8bbb6732775f tempest-VolumesBackupsTest-782410826 None] Lock "cinder-a8cbe8d3-34bb-4c13-afa9-f67aeb021217-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:17:25.576041 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-34fd7db0-6535-47c8-8b26-8bbb6732775f tempest-VolumesBackupsTest-782410826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:26.182540 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-34fd7db0-6535-47c8-8b26-8bbb6732775f tempest-VolumesBackupsTest-782410826 None] Volume volume-a8cbe8d3-34bb-4c13-afa9-f67aeb021217 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:17:26.202732 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-34fd7db0-6535-47c8-8b26-8bbb6732775f tempest-VolumesBackupsTest-782410826 None] deleting rbd volume volume-a8cbe8d3-34bb-4c13-afa9-f67aeb021217 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:17:26.575779 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-34fd7db0-6535-47c8-8b26-8bbb6732775f tempest-VolumesBackupsTest-782410826 None] Created reservations ['fc2b5054-a7da-4d19-a932-c54b4e53dab6', '138a5377-466f-4b0a-bf87-681b7634380a', 'e45b591c-806b-4863-bb15-195b36a4f2e6', 'acc9a592-47c8-456d-9270-1fd442b3dfbe'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:17:26.674959 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-34fd7db0-6535-47c8-8b26-8bbb6732775f tempest-VolumesBackupsTest-782410826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:26.758177 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-34fd7db0-6535-47c8-8b26-8bbb6732775f tempest-VolumesBackupsTest-782410826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:26.836338 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-34fd7db0-6535-47c8-8b26-8bbb6732775f tempest-VolumesBackupsTest-782410826 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:17:26.845433 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-34fd7db0-6535-47c8-8b26-8bbb6732775f tempest-VolumesBackupsTest-782410826 None] Deleted volume successfully.
Oct 29 21:17:26.866315 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-34fd7db0-6535-47c8-8b26-8bbb6732775f tempest-VolumesBackupsTest-782410826 None] Lock "cinder-a8cbe8d3-34bb-4c13-afa9-f67aeb021217-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:17:27.322114 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:17:27.350474 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Flow 'volume_create_manager' (36a1b207-f5aa-40c4-9f84-27d763da95ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:27.359028 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c82493-3474-44a6-8b1a-d199a0e5f297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:27.377850 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c82493-3474-44a6-8b1a-d199a0e5f297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1612342972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=59db4197-5063-46c7-b92c-0c4ca86237fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d823b5b6e143b1893ac4001ecee8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:17:27Z,use_quota=True,user_id='d3f40972099f47318f7c17c7e697054d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:27.384729 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ce3a2e-4e27-4364-9b44-a80b502b13c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:27.390488 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ce3a2e-4e27-4364-9b44-a80b502b13c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:27.398584 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f124c54-d704-4f1a-a37c-54aa914252e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:27.522930 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f124c54-d704-4f1a-a37c-54aa914252e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '59db4197-5063-46c7-b92c-0c4ca86237fe', 'volume_name': 'volume-59db4197-5063-46c7-b92c-0c4ca86237fe', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93466fed90>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:27.529024 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5570c080-8bff-4c72-935a-c08a3e40d281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:27.533011 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5570c080-8bff-4c72-935a-c08a3e40d281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:27.540447 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2daa0470-ba44-4330-a0f0-06b932e7d775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:27.541766 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Volume 59db4197-5063-46c7-b92c-0c4ca86237fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-59db4197-5063-46c7-b92c-0c4ca86237fe', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93466fed90>}
Oct 29 21:17:27.542657 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Cloning 59db4197-5063-46c7-b92c-0c4ca86237fe from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 21:17:27.543717 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:17:27.552748 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:17:27.565318 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 17, 27, 557616)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:17:27.565955 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:17:27.566535 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Found cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 29 21:17:27.572750 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 0.019s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:17:27.575497 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 21:17:27.584858 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 17, 27, 581035)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:17:27.585516 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:17:27.585768 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Creating from source image-volume fbe0dd2e-351a-4779-844d-3c66baf14939 {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 29 21:17:27.599384 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:27.669259 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] creating snapshot='volume-59db4197-5063-46c7-b92c-0c4ca86237fe.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 21:17:28.408707 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] cloning 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939@volume-59db4197-5063-46c7-b92c-0c4ca86237fe.clone_snap' to 'volume-59db4197-5063-46c7-b92c-0c4ca86237fe' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 21:17:28.611591 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:17:28.615966 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:17:28.616568 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:17:28.638197 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 21:17:28.638833 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Marking volume 59db4197-5063-46c7-b92c-0c4ca86237fe as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 21:17:28.651659 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to 59db4197-5063-46c7-b92c-0c4ca86237fe. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 21:17:28.651858 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Creating volume glance metadata for volume 59db4197-5063-46c7-b92c-0c4ca86237fe backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 21:17:28.744694 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2daa0470-ba44-4330-a0f0-06b932e7d775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59db4197-5063-46c7-b92c-0c4ca86237fe', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93466fed90>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:28.771148 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2bb80d-52bc-4cec-b054-98ddc95944ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:28.794999 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Volume volume-59db4197-5063-46c7-b92c-0c4ca86237fe (59db4197-5063-46c7-b92c-0c4ca86237fe): created successfully
Oct 29 21:17:28.809158 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2bb80d-52bc-4cec-b054-98ddc95944ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:28.820900 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Flow 'volume_create_manager' (36a1b207-f5aa-40c4-9f84-27d763da95ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:28.841788 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-ecf87b49-740c-40db-a023-78e10ea72484 tempest-VolumesBackupsTest-782410826 None] Created volume successfully.
Oct 29 21:17:29.871660 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-507ba33f-e473-49fa-adf3-1bb399cbe11b tempest-VolumesBackupsTest-782410826 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-29T21:17:29Z,data_timestamp=2022-10-29T21:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-846056990',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=362ed2b1-ba73-4282-9cd1-7afff762fec3,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='99d823b5b6e143b1893ac4001ecee8f5',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='d3f40972099f47318f7c17c7e697054d',volume_id=59db4197-5063-46c7-b92c-0c4ca86237fe)
Oct 29 21:17:29.873272 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.backup.rpcapi [None req-507ba33f-e473-49fa-adf3-1bb399cbe11b tempest-VolumesBackupsTest-782410826 None] continue_backup in rpcapi backup_id 362ed2b1-ba73-4282-9cd1-7afff762fec3 {{(pid=131780) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Oct 29 21:17:30.010721 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-507ba33f-e473-49fa-adf3-1bb399cbe11b tempest-VolumesBackupsTest-782410826 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:17:31.019300 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-507ba33f-e473-49fa-adf3-1bb399cbe11b tempest-VolumesBackupsTest-782410826 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.008s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:17:31.023314 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-507ba33f-e473-49fa-adf3-1bb399cbe11b tempest-VolumesBackupsTest-782410826 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-59db4197-5063-46c7-b92c-0c4ca86237fe', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '59db4197-5063-46c7-b92c-0c4ca86237fe', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:17:31.047815 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-507ba33f-e473-49fa-adf3-1bb399cbe11b tempest-VolumesBackupsTest-782410826 None] Initialize volume connection completed successfully.
Oct 29 21:17:33.186510 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=68,cinder:UPDATE=20,cinder:INSERT=11,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:17:36.359787 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:17:36.415035 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Flow 'volume_create_manager' (02339f0a-3595-4c77-8796-fa64af075f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:36.435729 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474db1d9-8e3f-4608-80dd-0770c3124321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:36.475470 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474db1d9-8e3f-4608-80dd-0770c3124321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1896015728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=50477e70-ad99-4cb2-866c-268cc795a3db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f76f1822e247a8a5141682b4995e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:17:36Z,use_quota=True,user_id='588b52a7fd1d4291b3a32bdd9d93f462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:36.480894 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbce2bfd-8731-4970-91a9-4d89523d0601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:36.498711 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbce2bfd-8731-4970-91a9-4d89523d0601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:36.507050 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2544e8b0-7268-415c-a790-a10652f1b5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:36.511146 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2544e8b0-7268-415c-a790-a10652f1b5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50477e70-ad99-4cb2-866c-268cc795a3db', 'volume_name': 'volume-50477e70-ad99-4cb2-866c-268cc795a3db', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:36.516168 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff695f3-d52b-4907-8b98-7928b6f332b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:36.521205 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff695f3-d52b-4907-8b98-7928b6f332b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:36.526988 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2eea52-b661-4686-a988-9a8e01d84d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:36.528439 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Volume 50477e70-ad99-4cb2-866c-268cc795a3db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50477e70-ad99-4cb2-866c-268cc795a3db', 'volume_size': 1}
Oct 29 21:17:36.529042 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] creating volume 'volume-50477e70-ad99-4cb2-866c-268cc795a3db' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:17:36.530461 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:36.738999 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:17:36.739568 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:17:36.769067 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2eea52-b661-4686-a988-9a8e01d84d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50477e70-ad99-4cb2-866c-268cc795a3db', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:36.781775 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8398c4-bcb6-4d52-8102-66be39483425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:36.830161 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Volume volume-50477e70-ad99-4cb2-866c-268cc795a3db (50477e70-ad99-4cb2-866c-268cc795a3db): created successfully
Oct 29 21:17:36.839953 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8398c4-bcb6-4d52-8102-66be39483425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:36.850584 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Flow 'volume_create_manager' (02339f0a-3595-4c77-8796-fa64af075f1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:36.862189 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f1044c78-40d8-4708-8536-6df3e62d9796 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Created volume successfully.
Oct 29 21:17:37.631712 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c20f37e4-53cd-431b-8c71-2722640ca56b tempest-VolumeQuotasAdminTestJSON-1973794866 None] Acquiring lock "cinder-50477e70-ad99-4cb2-866c-268cc795a3db-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:17:37.653412 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c20f37e4-53cd-431b-8c71-2722640ca56b tempest-VolumeQuotasAdminTestJSON-1973794866 None] Lock "cinder-50477e70-ad99-4cb2-866c-268cc795a3db-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:17:37.761041 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c20f37e4-53cd-431b-8c71-2722640ca56b tempest-VolumeQuotasAdminTestJSON-1973794866 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:37.913967 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c20f37e4-53cd-431b-8c71-2722640ca56b tempest-VolumeQuotasAdminTestJSON-1973794866 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:17:37.914789 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c20f37e4-53cd-431b-8c71-2722640ca56b tempest-VolumeQuotasAdminTestJSON-1973794866 None] Volume volume-50477e70-ad99-4cb2-866c-268cc795a3db is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:17:37.930939 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c20f37e4-53cd-431b-8c71-2722640ca56b tempest-VolumeQuotasAdminTestJSON-1973794866 None] deleting rbd volume volume-50477e70-ad99-4cb2-866c-268cc795a3db {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:17:39.080516 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-c20f37e4-53cd-431b-8c71-2722640ca56b tempest-VolumeQuotasAdminTestJSON-1973794866 None] Created reservations ['9b6a58b8-f112-4910-8848-8c0a011261b5', 'feb68173-a515-49bb-ad5a-73ccaf83814d', '0b8b08f5-de65-4836-ac4f-e397980ffd54', '01cbe7ab-7fec-4086-afc9-fd3697e50551'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:17:39.170978 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c20f37e4-53cd-431b-8c71-2722640ca56b tempest-VolumeQuotasAdminTestJSON-1973794866 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:39.221474 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c20f37e4-53cd-431b-8c71-2722640ca56b tempest-VolumeQuotasAdminTestJSON-1973794866 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:39.280909 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-c20f37e4-53cd-431b-8c71-2722640ca56b tempest-VolumeQuotasAdminTestJSON-1973794866 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:17:39.286204 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-c20f37e4-53cd-431b-8c71-2722640ca56b tempest-VolumeQuotasAdminTestJSON-1973794866 None] Deleted volume successfully.
Oct 29 21:17:39.302590 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c20f37e4-53cd-431b-8c71-2722640ca56b tempest-VolumeQuotasAdminTestJSON-1973794866 None] Lock "cinder-50477e70-ad99-4cb2-866c-268cc795a3db-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:17:39.740416 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=61,cinder:INSERT=13,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:17:39.750665 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-507ba33f-e473-49fa-adf3-1bb399cbe11b tempest-VolumesBackupsTest-782410826 None] Terminate volume connection completed successfully.
Oct 29 21:17:39.772733 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-507ba33f-e473-49fa-adf3-1bb399cbe11b tempest-VolumesBackupsTest-782410826 None] Remove volume export completed successfully.
Oct 29 21:17:40.358981 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:17:40.385225 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Flow 'volume_create_manager' (e5320a56-e9b1-4a26-be14-a38b0f1e3b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:40.391747 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c20c2b-aa4f-428b-ba60-57b667e540c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:40.413996 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c20c2b-aa4f-428b-ba60-57b667e540c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1941492726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=032c3789-f5b7-4e42-9018-6f0b0eaf7dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f76f1822e247a8a5141682b4995e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:17:40Z,use_quota=True,user_id='588b52a7fd1d4291b3a32bdd9d93f462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:40.431371 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31450df2-2f80-4cd6-99e8-70c95a662e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:40.435860 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31450df2-2f80-4cd6-99e8-70c95a662e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:40.440968 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0a8876-7195-4601-b0d3-41ff1e789e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:40.447556 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0a8876-7195-4601-b0d3-41ff1e789e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032c3789-f5b7-4e42-9018-6f0b0eaf7dc6', 'volume_name': 'volume-032c3789-f5b7-4e42-9018-6f0b0eaf7dc6', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:40.454059 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf42da61-ac51-499a-9304-494c0bb0f812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:40.458917 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf42da61-ac51-499a-9304-494c0bb0f812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:40.464071 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1db7754-574d-46b9-abc3-c95f52256a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:40.465862 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Volume 032c3789-f5b7-4e42-9018-6f0b0eaf7dc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032c3789-f5b7-4e42-9018-6f0b0eaf7dc6', 'volume_size': 1}
Oct 29 21:17:40.466432 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] creating volume 'volume-032c3789-f5b7-4e42-9018-6f0b0eaf7dc6' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:17:40.467380 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:40.560097 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:17:40.561509 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:17:40.569088 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1db7754-574d-46b9-abc3-c95f52256a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032c3789-f5b7-4e42-9018-6f0b0eaf7dc6', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:40.577605 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37699464-4a54-4995-9a0f-7917775ea043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:40.607665 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Volume volume-032c3789-f5b7-4e42-9018-6f0b0eaf7dc6 (032c3789-f5b7-4e42-9018-6f0b0eaf7dc6): created successfully
Oct 29 21:17:40.614281 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37699464-4a54-4995-9a0f-7917775ea043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:40.622842 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Flow 'volume_create_manager' (e5320a56-e9b1-4a26-be14-a38b0f1e3b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:40.639561 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-3a3184fa-ee99-40b1-a843-fd784a718637 tempest-VolumeQuotasAdminTestJSON-1973794866 None] Created volume successfully.
Oct 29 21:17:40.983906 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:17:41.006386 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Flow 'volume_create_manager' (0a64a68b-76f9-4d31-a107-a5578358ec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:41.014545 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf2b351-57d5-4e92-9aff-420af3321be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:41.031804 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf2b351-57d5-4e92-9aff-420af3321be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:17:41Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_362ed2b1-ba73-4282-9cd1-7afff762fec3',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a5b670c1-dab7-4923-9172-d33d40ca958e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d823b5b6e143b1893ac4001ecee8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:17:41Z,use_quota=True,user_id='d3f40972099f47318f7c17c7e697054d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:41.039045 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165f21ac-ea6d-4eb9-9383-ab8330911a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:41.044541 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165f21ac-ea6d-4eb9-9383-ab8330911a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:41.050479 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35bc9060-096f-4d73-99af-f78357f63f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:41.055555 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35bc9060-096f-4d73-99af-f78357f63f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5b670c1-dab7-4923-9172-d33d40ca958e', 'volume_name': 'volume-a5b670c1-dab7-4923-9172-d33d40ca958e', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:41.060975 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845319ec-8683-47b1-96a1-ebb392c78740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:41.065243 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845319ec-8683-47b1-96a1-ebb392c78740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:41.070149 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06331f7-8534-40ae-a416-be839fd27aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:41.071400 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Volume a5b670c1-dab7-4923-9172-d33d40ca958e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5b670c1-dab7-4923-9172-d33d40ca958e', 'volume_size': 1}
Oct 29 21:17:41.071978 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] creating volume 'volume-a5b670c1-dab7-4923-9172-d33d40ca958e' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:17:41.072785 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:41.156700 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:17:41.157143 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:17:41.161592 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06331f7-8534-40ae-a416-be839fd27aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b670c1-dab7-4923-9172-d33d40ca958e', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:41.166412 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cd5687-c339-4b7f-8846-b498fd82d0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:41.178115 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Volume volume-a5b670c1-dab7-4923-9172-d33d40ca958e (a5b670c1-dab7-4923-9172-d33d40ca958e): created successfully
Oct 29 21:17:41.181994 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cd5687-c339-4b7f-8846-b498fd82d0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:41.187320 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Flow 'volume_create_manager' (0a64a68b-76f9-4d31-a107-a5578358ec3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:41.205551 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Created volume successfully.
Oct 29 21:17:42.068318 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:17:42.179079 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-8aa63df6-0a55-4424-8cef-6f315e72def8 tempest-VolumeQuotasAdminTestJSON-150103772 None] Transfer volume completed successfully.
Oct 29 21:17:42.697233 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-adf4b504-8a3b-45b0-b7f3-956665ed2f6b tempest-VolumeQuotasAdminTestJSON-1173903973 None] Acquiring lock "cinder-032c3789-f5b7-4e42-9018-6f0b0eaf7dc6-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:17:42.726931 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-adf4b504-8a3b-45b0-b7f3-956665ed2f6b tempest-VolumeQuotasAdminTestJSON-1173903973 None] Lock "cinder-032c3789-f5b7-4e42-9018-6f0b0eaf7dc6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:17:42.786093 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-adf4b504-8a3b-45b0-b7f3-956665ed2f6b tempest-VolumeQuotasAdminTestJSON-1173903973 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:42.853652 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-adf4b504-8a3b-45b0-b7f3-956665ed2f6b tempest-VolumeQuotasAdminTestJSON-1173903973 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:17:42.854116 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-adf4b504-8a3b-45b0-b7f3-956665ed2f6b tempest-VolumeQuotasAdminTestJSON-1173903973 None] Volume volume-032c3789-f5b7-4e42-9018-6f0b0eaf7dc6 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:17:42.860429 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-adf4b504-8a3b-45b0-b7f3-956665ed2f6b tempest-VolumeQuotasAdminTestJSON-1173903973 None] deleting rbd volume volume-032c3789-f5b7-4e42-9018-6f0b0eaf7dc6 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:17:43.070382 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.002s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:17:43.071871 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a5b670c1-dab7-4923-9172-d33d40ca958e', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'a5b670c1-dab7-4923-9172-d33d40ca958e', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:17:43.090930 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Initialize volume connection completed successfully.
Oct 29 21:17:43.241743 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-adf4b504-8a3b-45b0-b7f3-956665ed2f6b tempest-VolumeQuotasAdminTestJSON-1173903973 None] Created reservations ['38ed4057-43cc-4021-aa93-b14fe761857a', '7ac1ab2b-0344-45ee-92ec-28b98a57666c', '83e232f6-d523-46d4-b5d5-03ea53da6b67', '773266e3-792f-4070-9153-14e560c6f935'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:17:43.336899 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-adf4b504-8a3b-45b0-b7f3-956665ed2f6b tempest-VolumeQuotasAdminTestJSON-1173903973 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:43.405202 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-adf4b504-8a3b-45b0-b7f3-956665ed2f6b tempest-VolumeQuotasAdminTestJSON-1173903973 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:43.476727 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-adf4b504-8a3b-45b0-b7f3-956665ed2f6b tempest-VolumeQuotasAdminTestJSON-1173903973 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:17:43.482166 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-adf4b504-8a3b-45b0-b7f3-956665ed2f6b tempest-VolumeQuotasAdminTestJSON-1173903973 None] Deleted volume successfully.
Oct 29 21:17:43.505139 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-adf4b504-8a3b-45b0-b7f3-956665ed2f6b tempest-VolumeQuotasAdminTestJSON-1173903973 None] Lock "cinder-032c3789-f5b7-4e42-9018-6f0b0eaf7dc6-delete_volume" released by "delete_volume" :: held 0.778s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:17:48.368093 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Terminate volume connection completed successfully.
Oct 29 21:17:48.390910 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1ca39d5d-075f-45db-b7b7-cd3c678a9344 tempest-VolumesBackupsTest-782410826 None] Remove volume export completed successfully.
Oct 29 21:17:49.567092 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ca7d0420-fdfc-419b-8a1a-a0a2d8d1d637 tempest-VolumesBackupsTest-782410826 None] Acquiring lock "cinder-a5b670c1-dab7-4923-9172-d33d40ca958e-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:17:49.586837 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ca7d0420-fdfc-419b-8a1a-a0a2d8d1d637 tempest-VolumesBackupsTest-782410826 None] Lock "cinder-a5b670c1-dab7-4923-9172-d33d40ca958e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:17:49.636638 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ca7d0420-fdfc-419b-8a1a-a0a2d8d1d637 tempest-VolumesBackupsTest-782410826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:49.825981 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ca7d0420-fdfc-419b-8a1a-a0a2d8d1d637 tempest-VolumesBackupsTest-782410826 None] Volume volume-a5b670c1-dab7-4923-9172-d33d40ca958e is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:17:49.841531 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ca7d0420-fdfc-419b-8a1a-a0a2d8d1d637 tempest-VolumesBackupsTest-782410826 None] deleting rbd volume volume-a5b670c1-dab7-4923-9172-d33d40ca958e {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:17:50.402750 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-ca7d0420-fdfc-419b-8a1a-a0a2d8d1d637 tempest-VolumesBackupsTest-782410826 None] Created reservations ['fe24de2d-1a52-4d73-b474-a3217deb355c', 'b102a2a9-5a7e-41df-956e-3978761909c2', '972324f1-5f2e-468c-8339-0bcf9fa3888f', '44b70898-a566-41bb-ae2f-8b15f4fa251f'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:17:50.478689 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ca7d0420-fdfc-419b-8a1a-a0a2d8d1d637 tempest-VolumesBackupsTest-782410826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:50.540150 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ca7d0420-fdfc-419b-8a1a-a0a2d8d1d637 tempest-VolumesBackupsTest-782410826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:50.572740 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-ca7d0420-fdfc-419b-8a1a-a0a2d8d1d637 tempest-VolumesBackupsTest-782410826 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:17:50.576994 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-ca7d0420-fdfc-419b-8a1a-a0a2d8d1d637 tempest-VolumesBackupsTest-782410826 None] Deleted volume successfully.
Oct 29 21:17:50.622011 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ca7d0420-fdfc-419b-8a1a-a0a2d8d1d637 tempest-VolumesBackupsTest-782410826 None] Lock "cinder-a5b670c1-dab7-4923-9172-d33d40ca958e-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:17:50.666056 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-c998d384-5d38-460c-adae-27fbbd7be8b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['a3e0b7ff-70aa-40b7-b227-2407ee121e68', '18f35327-73c6-4c02-a424-849a1c5a2575', '32beb229-47c1-41d4-8d6f-4924b040e4d7', '140a61c3-be5c-4d7e-8f0f-eb1dc32e111c'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:17:50.671242 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=66,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:17:50.724982 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-c998d384-5d38-460c-adae-27fbbd7be8b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Delete snapshot completed successfully.
Oct 29 21:17:50.733675 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c998d384-5d38-460c-adae-27fbbd7be8b2 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-a542b13b-c010-45d6-ab5c-527a24711598-delete_snapshot" released by "delete_snapshot" :: held 30.401s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:17:51.319324 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:17:51.351629 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Flow 'volume_create_manager' (3d1ca525-7db3-4910-8cee-4d849e81b847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:51.358069 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb73918-3c00-4185-87fa-742e6fca07b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:51.377926 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb73918-3c00-4185-87fa-742e6fca07b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-334641232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2668e966-621e-4edf-b45a-d35b483cdec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bbd1505620f48df83bb173c849502cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:17:51Z,use_quota=True,user_id='a9c4e28023954215abdacc28e4ccc38e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f159f241-d3a4-4db3-9294-154d328a96cc),volume_type_id=f159f241-d3a4-4db3-9294-154d328a96cc)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:51.384191 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b906dde9-66a2-4674-8b84-6981ba7d6562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:51.388297 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b906dde9-66a2-4674-8b84-6981ba7d6562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:51.393368 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9077ffbb-b5a9-4128-9cc0-81c3c2c548ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:51.400342 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9077ffbb-b5a9-4128-9cc0-81c3c2c548ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2668e966-621e-4edf-b45a-d35b483cdec0', 'volume_name': 'volume-2668e966-621e-4edf-b45a-d35b483cdec0', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:51.405964 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87dc8fc5-a3d9-4eba-8f54-021178ea2984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:51.410135 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87dc8fc5-a3d9-4eba-8f54-021178ea2984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:51.415497 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4881166-2bc1-4285-9e5e-965526922908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:51.416793 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Volume 2668e966-621e-4edf-b45a-d35b483cdec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2668e966-621e-4edf-b45a-d35b483cdec0', 'volume_size': 1}
Oct 29 21:17:51.417712 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] creating volume 'volume-2668e966-621e-4edf-b45a-d35b483cdec0' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:17:51.419401 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:51.516307 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:17:51.517920 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:17:51.526636 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4881166-2bc1-4285-9e5e-965526922908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2668e966-621e-4edf-b45a-d35b483cdec0', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:51.540818 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817a4081-7a98-4d8c-b244-2a48512be54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:51.555293 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Volume volume-2668e966-621e-4edf-b45a-d35b483cdec0 (2668e966-621e-4edf-b45a-d35b483cdec0): created successfully
Oct 29 21:17:51.559364 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817a4081-7a98-4d8c-b244-2a48512be54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:51.565207 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Flow 'volume_create_manager' (3d1ca525-7db3-4910-8cee-4d849e81b847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:51.575893 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-75034cc4-43c2-49aa-bddb-8e166555390b tempest-VolumeTypesTest-331678308 None] Created volume successfully.
Oct 29 21:17:52.167828 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-dcadac76-e1b0-49ca-83b1-b0fc00291db5 req-fe83b672-1725-4bc6-9d41-5d3d14080455 tempest-VolumesSnapshotTestJSON-1969201650 None] Terminate volume connection completed successfully.
Oct 29 21:17:52.168493 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-dcadac76-e1b0-49ca-83b1-b0fc00291db5 req-fe83b672-1725-4bc6-9d41-5d3d14080455 tempest-VolumesSnapshotTestJSON-1969201650 None] Deleting attachment b563f75f-0a1f-4e2a-bc78-969259c05975. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:17:52.807506 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=57,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=8 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:17:52.921313 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-716e2679-89b6-4f38-8372-f0a046430728 tempest-VolumeTypesTest-331678308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:52.972448 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-716e2679-89b6-4f38-8372-f0a046430728 tempest-VolumeTypesTest-331678308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:53.023897 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-716e2679-89b6-4f38-8372-f0a046430728 tempest-VolumeTypesTest-331678308 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:17:53.031589 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-d0c5b78f-9cbf-4da2-a7da-fc869dac6d74 tempest-VolumesBackupsTest-782410826 None] Acquiring lock "cinder-59db4197-5063-46c7-b92c-0c4ca86237fe-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:17:53.037312 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-716e2679-89b6-4f38-8372-f0a046430728 tempest-VolumeTypesTest-331678308 None] Retype volume completed successfully.
Oct 29 21:17:53.048657 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-d0c5b78f-9cbf-4da2-a7da-fc869dac6d74 tempest-VolumesBackupsTest-782410826 None] Lock "cinder-59db4197-5063-46c7-b92c-0c4ca86237fe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:17:53.086882 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d0c5b78f-9cbf-4da2-a7da-fc869dac6d74 tempest-VolumesBackupsTest-782410826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:53.909048 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d0c5b78f-9cbf-4da2-a7da-fc869dac6d74 tempest-VolumesBackupsTest-782410826 None] deleting rbd volume volume-59db4197-5063-46c7-b92c-0c4ca86237fe {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:17:54.185917 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d0c5b78f-9cbf-4da2-a7da-fc869dac6d74 tempest-VolumesBackupsTest-782410826 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 21:17:54.242703 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d0c5b78f-9cbf-4da2-a7da-fc869dac6d74 tempest-VolumesBackupsTest-782410826 None] deleting parent snapshot volume-59db4197-5063-46c7-b92c-0c4ca86237fe.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 21:17:55.040912 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-d0c5b78f-9cbf-4da2-a7da-fc869dac6d74 tempest-VolumesBackupsTest-782410826 None] Created reservations ['ac6e1c28-38b7-4b90-8a7e-9e7d68a13cd1', '055a9942-4db3-4f81-9b48-44855ebaffd5', 'f0df31da-4cd4-4749-af16-b3f23d5f51d2', 'de33d094-45fc-4325-af83-4023f0d77b6b'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:17:55.137551 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d0c5b78f-9cbf-4da2-a7da-fc869dac6d74 tempest-VolumesBackupsTest-782410826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:55.213916 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d0c5b78f-9cbf-4da2-a7da-fc869dac6d74 tempest-VolumesBackupsTest-782410826 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:55.271381 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-d0c5b78f-9cbf-4da2-a7da-fc869dac6d74 tempest-VolumesBackupsTest-782410826 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:17:55.283382 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-d0c5b78f-9cbf-4da2-a7da-fc869dac6d74 tempest-VolumesBackupsTest-782410826 None] Deleted volume successfully.
Oct 29 21:17:55.305269 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-d0c5b78f-9cbf-4da2-a7da-fc869dac6d74 tempest-VolumesBackupsTest-782410826 None] Lock "cinder-59db4197-5063-46c7-b92c-0c4ca86237fe-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:17:55.424605 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9c1bfed8-0395-4cc9-a784-913b572a90d2 tempest-VolumeTypesTest-331678308 None] Acquiring lock "cinder-2668e966-621e-4edf-b45a-d35b483cdec0-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:17:55.448914 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9c1bfed8-0395-4cc9-a784-913b572a90d2 tempest-VolumeTypesTest-331678308 None] Lock "cinder-2668e966-621e-4edf-b45a-d35b483cdec0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:17:55.579411 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9c1bfed8-0395-4cc9-a784-913b572a90d2 tempest-VolumeTypesTest-331678308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:55.677513 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9c1bfed8-0395-4cc9-a784-913b572a90d2 tempest-VolumeTypesTest-331678308 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:17:55.677957 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9c1bfed8-0395-4cc9-a784-913b572a90d2 tempest-VolumeTypesTest-331678308 None] Volume volume-2668e966-621e-4edf-b45a-d35b483cdec0 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:17:55.692406 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9c1bfed8-0395-4cc9-a784-913b572a90d2 tempest-VolumeTypesTest-331678308 None] deleting rbd volume volume-2668e966-621e-4edf-b45a-d35b483cdec0 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:17:56.043266 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-9c1bfed8-0395-4cc9-a784-913b572a90d2 tempest-VolumeTypesTest-331678308 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-994147463 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-994147463, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:17:56.045093 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-9c1bfed8-0395-4cc9-a784-913b572a90d2 tempest-VolumeTypesTest-331678308 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-994147463 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-994147463, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:17:56.076426 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-9c1bfed8-0395-4cc9-a784-913b572a90d2 tempest-VolumeTypesTest-331678308 None] Created reservations ['4474aff3-a856-4733-853f-9d622a3fc457', '3b68e320-a604-4a79-b6ce-402e0682c044', '76497a04-81b4-4ed5-acba-6d6563dbe6bd', 'a59e1409-a7f5-45d1-9af1-03633e75536e'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:17:56.144895 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9c1bfed8-0395-4cc9-a784-913b572a90d2 tempest-VolumeTypesTest-331678308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:56.254452 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9c1bfed8-0395-4cc9-a784-913b572a90d2 tempest-VolumeTypesTest-331678308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:56.308594 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-9c1bfed8-0395-4cc9-a784-913b572a90d2 tempest-VolumeTypesTest-331678308 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:17:56.335209 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-9c1bfed8-0395-4cc9-a784-913b572a90d2 tempest-VolumeTypesTest-331678308 None] Deleted volume successfully.
Oct 29 21:17:56.340639 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:17:56.360949 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Flow 'volume_create_manager' (e796175e-b0bf-4acc-b1aa-201c2804e076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:56.368028 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ae740b-494d-4fba-906f-a20da48429bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:56.404071 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ae740b-494d-4fba-906f-a20da48429bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-953294788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0821f152-b7d0-4830-89bb-1c904423eab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49dda6b9aedb4e678da591c1a087c56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:17:56Z,use_quota=True,user_id='d680273b59464d5fa1d3976c7ee26564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:56.411124 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e45b928-4f49-44ab-86ad-a0cb3c50c2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:56.416107 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e45b928-4f49-44ab-86ad-a0cb3c50c2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:56.424018 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e024e9c5-417f-4612-95d1-eae10c6d67e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:56.429208 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e024e9c5-417f-4612-95d1-eae10c6d67e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0821f152-b7d0-4830-89bb-1c904423eab2', 'volume_name': 'volume-0821f152-b7d0-4830-89bb-1c904423eab2', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:56.435517 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53757a03-7bb8-49e4-89ef-d0475487ea23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:56.440009 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53757a03-7bb8-49e4-89ef-d0475487ea23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:56.444906 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca97d03-042e-4b87-8e83-2bf5f680c772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:56.446414 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Volume 0821f152-b7d0-4830-89bb-1c904423eab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0821f152-b7d0-4830-89bb-1c904423eab2', 'volume_size': 1}
Oct 29 21:17:56.446917 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] creating volume 'volume-0821f152-b7d0-4830-89bb-1c904423eab2' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:17:56.447765 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:56.536293 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9c1bfed8-0395-4cc9-a784-913b572a90d2 tempest-VolumeTypesTest-331678308 None] Lock "cinder-2668e966-621e-4edf-b45a-d35b483cdec0-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:17:56.589474 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:17:56.590353 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:17:56.594487 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ca97d03-042e-4b87-8e83-2bf5f680c772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0821f152-b7d0-4830-89bb-1c904423eab2', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:56.601381 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26a7ea3-f4d8-4f90-a156-bb89491c1078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:56.616772 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Volume volume-0821f152-b7d0-4830-89bb-1c904423eab2 (0821f152-b7d0-4830-89bb-1c904423eab2): created successfully
Oct 29 21:17:56.627881 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26a7ea3-f4d8-4f90-a156-bb89491c1078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:56.643777 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Flow 'volume_create_manager' (e796175e-b0bf-4acc-b1aa-201c2804e076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:56.659210 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-8c08e3b1-73a2-49b2-a74b-46bb9dc096f0 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Created volume successfully.
Oct 29 21:17:58.133649 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:17:58.185351 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Flow 'volume_create_manager' (24952c3f-a140-443e-94dc-79f678e30d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:58.222303 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf67bb05-6e03-417a-a0bc-3242f3b6e922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:58.267500 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf67bb05-6e03-417a-a0bc-3242f3b6e922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-107731047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=05cdf37d-5109-4a68-a702-417919e1f137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10601894adb44985b208c3ab7ffa22c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:17:58Z,use_quota=True,user_id='04bbe6295ba34150b3609466e42c8abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:58.282901 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10f2c4b-70ed-47d9-acf5-ab5ba231ceb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:58.294688 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10f2c4b-70ed-47d9-acf5-ab5ba231ceb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:58.302099 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0fe896-335b-4d0e-8a5a-4b980462043d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:58.307901 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0fe896-335b-4d0e-8a5a-4b980462043d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05cdf37d-5109-4a68-a702-417919e1f137', 'volume_name': 'volume-05cdf37d-5109-4a68-a702-417919e1f137', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:58.314916 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb51bb0-f832-4745-afaa-daafc619ca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:58.325300 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb51bb0-f832-4745-afaa-daafc619ca8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:58.332991 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b76917c-dc24-4365-abba-11d1cdbcb311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:58.335113 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Volume 05cdf37d-5109-4a68-a702-417919e1f137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05cdf37d-5109-4a68-a702-417919e1f137', 'volume_size': 1}
Oct 29 21:17:58.335613 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] creating volume 'volume-05cdf37d-5109-4a68-a702-417919e1f137' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:17:58.337485 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:58.468467 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:17:58.468945 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:17:58.473900 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b76917c-dc24-4365-abba-11d1cdbcb311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05cdf37d-5109-4a68-a702-417919e1f137', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:58.484979 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ddc466-c041-4869-9e7b-6ed14f990ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:58.505859 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Volume volume-05cdf37d-5109-4a68-a702-417919e1f137 (05cdf37d-5109-4a68-a702-417919e1f137): created successfully
Oct 29 21:17:58.512595 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ddc466-c041-4869-9e7b-6ed14f990ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:58.526072 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Flow 'volume_create_manager' (24952c3f-a140-443e-94dc-79f678e30d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:58.543240 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-0365a0d2-b5c4-4ac2-b792-24bb436db917 tempest-VolumesSnapshotTestJSON-1969201650 None] Created volume successfully.
Oct 29 21:17:58.977304 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c385d55c-93ec-4810-a232-282fdf443238 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Acquiring lock "cinder-0821f152-b7d0-4830-89bb-1c904423eab2-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:17:58.998029 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c385d55c-93ec-4810-a232-282fdf443238 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Lock "cinder-0821f152-b7d0-4830-89bb-1c904423eab2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:17:59.121299 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c385d55c-93ec-4810-a232-282fdf443238 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:59.219449 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c385d55c-93ec-4810-a232-282fdf443238 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:17:59.220625 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c385d55c-93ec-4810-a232-282fdf443238 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Volume volume-0821f152-b7d0-4830-89bb-1c904423eab2 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:17:59.231587 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c385d55c-93ec-4810-a232-282fdf443238 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] deleting rbd volume volume-0821f152-b7d0-4830-89bb-1c904423eab2 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:17:59.284672 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:17:59.335387 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Flow 'volume_create_manager' (8867fc7f-6d56-4f28-9c2e-7daeec425f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:59.358361 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fefe59-9b2c-43d1-acd2-b06919126a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:59.408851 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fefe59-9b2c-43d1-acd2-b06919126a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1609565662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=648d9275-b6e9-4edb-bc1e-85914451cce2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbee029e55124f2bb37672fbee64a42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:17:59Z,use_quota=True,user_id='f21c99f8530a41439b59b8dbaf2369dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:59.421487 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899e0fe4-b7ff-495b-be13-2ecbc4ed5d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:59.428565 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899e0fe4-b7ff-495b-be13-2ecbc4ed5d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:59.438923 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdf67ac-08c5-4edf-b147-223c8a127f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:59.444401 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdf67ac-08c5-4edf-b147-223c8a127f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '648d9275-b6e9-4edb-bc1e-85914451cce2', 'volume_name': 'volume-648d9275-b6e9-4edb-bc1e-85914451cce2', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:59.451194 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f879127e-7bea-49d7-82b6-322c7c3d33f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:59.458199 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f879127e-7bea-49d7-82b6-322c7c3d33f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:59.463474 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d856cb-c9b0-404a-a54a-0025d1f22cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:59.464760 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Volume 648d9275-b6e9-4edb-bc1e-85914451cce2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-648d9275-b6e9-4edb-bc1e-85914451cce2', 'volume_size': 1}
Oct 29 21:17:59.465337 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] creating volume 'volume-648d9275-b6e9-4edb-bc1e-85914451cce2' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:17:59.466167 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:59.547459 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:17:59.547873 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:17:59.552814 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d856cb-c9b0-404a-a54a-0025d1f22cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-648d9275-b6e9-4edb-bc1e-85914451cce2', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:59.558001 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8e389a-4f42-4c7a-827e-59e1189fb20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:17:59.571626 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-20db1288-41c0-4119-abae-808267a0913d tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:59.637322 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Volume volume-648d9275-b6e9-4edb-bc1e-85914451cce2 (648d9275-b6e9-4edb-bc1e-85914451cce2): created successfully
Oct 29 21:17:59.641352 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8e389a-4f42-4c7a-827e-59e1189fb20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:17:59.648075 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Flow 'volume_create_manager' (8867fc7f-6d56-4f28-9c2e-7daeec425f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:17:59.661231 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-9b15054c-6d09-403b-8cf4-d245e1abc3eb tempest-AttachVolumeNegativeTest-2104062597 None] Created volume successfully.
Oct 29 21:17:59.680807 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-c385d55c-93ec-4810-a232-282fdf443238 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Created reservations ['1ba26dd3-9763-40d2-ac4b-cd7f96940a10', 'c4de12a3-4954-4d86-8e46-ef882ae2adb4', 'c353cdb4-54eb-4f3a-b7d3-2ffe8a41cda5', '2df41d1f-3e69-4a6a-9284-1c73d8e3ac3c'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:17:59.684952 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=32,cinder:SELECT=61,cinder:INSERT=5,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:17:59.694446 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=31,cinder:SELECT=59,cinder:INSERT=7,cinder:DELETE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:17:59.740100 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c385d55c-93ec-4810-a232-282fdf443238 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:59.784564 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c385d55c-93ec-4810-a232-282fdf443238 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:17:59.844467 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-c385d55c-93ec-4810-a232-282fdf443238 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:17:59.851788 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-c385d55c-93ec-4810-a232-282fdf443238 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Deleted volume successfully.
Oct 29 21:17:59.870211 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c385d55c-93ec-4810-a232-282fdf443238 tempest-VolumeQuotasNegativeTestJSON-1127912954 None] Lock "cinder-0821f152-b7d0-4830-89bb-1c904423eab2-delete_volume" released by "delete_volume" :: held 0.871s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:00.118058 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-20db1288-41c0-4119-abae-808267a0913d tempest-VolumesSnapshotTestJSON-1969201650 None] Create snapshot completed successfully
Oct 29 21:18:01.203091 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-e20f6fec-5012-4702-b160-33acda1dc62c req-1a57df8a-de3e-4feb-b4be-e4cab5a097c0 tempest-AttachVolumeNegativeTest-2104062597 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:18:01.393588 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:18:01.395102 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:01.506468 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:01.590951 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:01.669363 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:01.748764 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Flow 'volume_create_manager' (b89d8a68-a37d-49a0-8ac9-408cf99eb5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:01.756212 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846b33ab-e1ea-404e-a68f-6b216db4c184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:01.792156 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846b33ab-e1ea-404e-a68f-6b216db4c184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1497472981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f8f8e2b0-a92f-4f96-aa23-36589eff9fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10601894adb44985b208c3ab7ffa22c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e6a782a2-2e9c-4cdd-8fc4-c4876411f571,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:02Z,use_quota=True,user_id='04bbe6295ba34150b3609466e42c8abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:01.800678 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7914bc28-e63f-4cce-a6a9-e09161fc20e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:01.807524 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7914bc28-e63f-4cce-a6a9-e09161fc20e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:01.813305 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5817d3c3-2512-4f17-9ede-0cda00af9fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:01.819501 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5817d3c3-2512-4f17-9ede-0cda00af9fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f8f8e2b0-a92f-4f96-aa23-36589eff9fb0', 'volume_name': 'volume-f8f8e2b0-a92f-4f96-aa23-36589eff9fb0', 'volume_size': 2, 'snapshot_id': 'e6a782a2-2e9c-4cdd-8fc4-c4876411f571'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:01.849198 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea67967-bb20-4f6a-82e9-b25a7b2f8024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:01.858446 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea67967-bb20-4f6a-82e9-b25a7b2f8024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:01.868072 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (207caf05-4467-4994-b997-58b4c05dbb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:01.869188 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Volume f8f8e2b0-a92f-4f96-aa23-36589eff9fb0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f8f8e2b0-a92f-4f96-aa23-36589eff9fb0', 'volume_size': 2, 'snapshot_id': 'e6a782a2-2e9c-4cdd-8fc4-c4876411f571'}
Oct 29 21:18:01.919539 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] cloning volumes/volume-05cdf37d-5109-4a68-a702-417919e1f137@snapshot-e6a782a2-2e9c-4cdd-8fc4-c4876411f571 to volume-f8f8e2b0-a92f-4f96-aa23-36589eff9fb0 {{(pid=131780) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}}
Oct 29 21:18:01.920394 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:02.005348 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:02.237388 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:02.238603 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:02.244550 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:02.464023 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (207caf05-4467-4994-b997-58b4c05dbb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8f8e2b0-a92f-4f96-aa23-36589eff9fb0', 'volume_size': 2, 'snapshot_id': 'e6a782a2-2e9c-4cdd-8fc4-c4876411f571'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:02.479669 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb3512a-f57a-4943-ade3-d46b4bb5f3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:02.502792 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Volume volume-f8f8e2b0-a92f-4f96-aa23-36589eff9fb0 (f8f8e2b0-a92f-4f96-aa23-36589eff9fb0): created successfully
Oct 29 21:18:02.512463 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb3512a-f57a-4943-ade3-d46b4bb5f3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:02.530059 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Flow 'volume_create_manager' (b89d8a68-a37d-49a0-8ac9-408cf99eb5c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:02.565544 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f6630ebe-d3dc-48d0-a6fa-4eb22239c28b tempest-VolumesSnapshotTestJSON-1969201650 None] Created volume successfully.
Oct 29 21:18:02.666231 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-e20f6fec-5012-4702-b160-33acda1dc62c req-1a57df8a-de3e-4feb-b4be-e4cab5a097c0 tempest-AttachVolumeNegativeTest-2104062597 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.463s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:18:02.667852 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-e20f6fec-5012-4702-b160-33acda1dc62c req-1a57df8a-de3e-4feb-b4be-e4cab5a097c0 tempest-AttachVolumeNegativeTest-2104062597 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-648d9275-b6e9-4edb-bc1e-85914451cce2', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '648d9275-b6e9-4edb-bc1e-85914451cce2', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:18:02.718856 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e20f6fec-5012-4702-b160-33acda1dc62c req-1a57df8a-de3e-4feb-b4be-e4cab5a097c0 tempest-AttachVolumeNegativeTest-2104062597 None] Connection info returned from driver {'name': 'volumes/volume-648d9275-b6e9-4edb-bc1e-85914451cce2', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '648d9275-b6e9-4edb-bc1e-85914451cce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '94dd6799-5e4b-444e-a905-0eb1c9ae39d7'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:18:02.827056 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-e20f6fec-5012-4702-b160-33acda1dc62c req-1a57df8a-de3e-4feb-b4be-e4cab5a097c0 tempest-AttachVolumeNegativeTest-2104062597 None] attachment_update completed successfully.
Oct 29 21:18:03.953807 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-dde51c08-69a0-4265-aee4-b71b881bc67f tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-f8f8e2b0-a92f-4f96-aa23-36589eff9fb0-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:03.988292 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-dde51c08-69a0-4265-aee4-b71b881bc67f tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-f8f8e2b0-a92f-4f96-aa23-36589eff9fb0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:04.085616 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-dde51c08-69a0-4265-aee4-b71b881bc67f tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:04.240694 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-dde51c08-69a0-4265-aee4-b71b881bc67f tempest-VolumesSnapshotTestJSON-1969201650 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:04.254887 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-dde51c08-69a0-4265-aee4-b71b881bc67f tempest-VolumesSnapshotTestJSON-1969201650 None] deleting rbd volume volume-f8f8e2b0-a92f-4f96-aa23-36589eff9fb0 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:04.759518 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-dde51c08-69a0-4265-aee4-b71b881bc67f tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['5473e6f1-f8df-4e59-ad99-638e332492af', '9e8843ef-70ae-4a6c-9c3f-55b2e7697da0', 'fef4ac16-91cb-4af6-b727-21274624903d', '3a9fc267-cbde-40f1-a8bc-77bca2d8b66f'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:04.853401 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-dde51c08-69a0-4265-aee4-b71b881bc67f tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:04.926966 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-dde51c08-69a0-4265-aee4-b71b881bc67f tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:05.001315 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-dde51c08-69a0-4265-aee4-b71b881bc67f tempest-VolumesSnapshotTestJSON-1969201650 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:05.007387 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-dde51c08-69a0-4265-aee4-b71b881bc67f tempest-VolumesSnapshotTestJSON-1969201650 None] Deleted volume successfully.
Oct 29 21:18:05.035862 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-dde51c08-69a0-4265-aee4-b71b881bc67f tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-f8f8e2b0-a92f-4f96-aa23-36589eff9fb0-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:05.982908 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:06.088849 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Flow 'volume_create_manager' (3cb5c9fe-267b-4cf4-a79c-572f2f157ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:06.115966 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8baebb11-a0c7-4095-aca7-0ef223eacb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:06.169779 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8baebb11-a0c7-4095-aca7-0ef223eacb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-762293575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f6aa72e7-9cc5-4dd9-85f7-58feff1dc4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10601894adb44985b208c3ab7ffa22c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:06Z,use_quota=True,user_id='04bbe6295ba34150b3609466e42c8abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:06.178255 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e994ca-f0e9-41b2-86e1-e4af27eb037b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:06.183352 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e994ca-f0e9-41b2-86e1-e4af27eb037b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:06.188843 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad519e5e-fbde-4dc6-ba93-ce358bc44085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:06.193224 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad519e5e-fbde-4dc6-ba93-ce358bc44085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6aa72e7-9cc5-4dd9-85f7-58feff1dc4da', 'volume_name': 'volume-f6aa72e7-9cc5-4dd9-85f7-58feff1dc4da', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:06.198645 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b4ca42-3448-424a-b627-ae9fab229d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:06.203119 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b4ca42-3448-424a-b627-ae9fab229d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:06.210684 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b30eb1e-dd27-49b8-8cfe-409aad24c5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:06.212277 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Volume f6aa72e7-9cc5-4dd9-85f7-58feff1dc4da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6aa72e7-9cc5-4dd9-85f7-58feff1dc4da', 'volume_size': 1}
Oct 29 21:18:06.212861 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] creating volume 'volume-f6aa72e7-9cc5-4dd9-85f7-58feff1dc4da' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:18:06.214218 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:06.344264 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:06.344654 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:06.348928 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b30eb1e-dd27-49b8-8cfe-409aad24c5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6aa72e7-9cc5-4dd9-85f7-58feff1dc4da', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:06.358719 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7140ecbc-357d-4d4b-96d4-b0f6da33538b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:06.387765 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Volume volume-f6aa72e7-9cc5-4dd9-85f7-58feff1dc4da (f6aa72e7-9cc5-4dd9-85f7-58feff1dc4da): created successfully
Oct 29 21:18:06.400447 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7140ecbc-357d-4d4b-96d4-b0f6da33538b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:06.414630 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Flow 'volume_create_manager' (3cb5c9fe-267b-4cf4-a79c-572f2f157ba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:06.431759 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-179edcf5-7cd4-4ec5-8746-ca63b47f5440 tempest-VolumesSnapshotTestJSON-1969201650 None] Created volume successfully.
Oct 29 21:18:06.887119 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-e39f9fea-38c4-453c-ab7e-adfdee88c3f0 req-cf4878bc-85b3-408b-984a-6a1dac69f294 tempest-AttachVolumeNegativeTest-2104062597 None] Terminate volume connection completed successfully.
Oct 29 21:18:06.889405 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e39f9fea-38c4-453c-ab7e-adfdee88c3f0 req-cf4878bc-85b3-408b-984a-6a1dac69f294 tempest-AttachVolumeNegativeTest-2104062597 None] Deleting attachment 94dd6799-5e4b-444e-a905-0eb1c9ae39d7. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:18:07.824691 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8e04c048-30a6-4289-89e8-1cf4b713e17e tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:08.624523 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-8e04c048-30a6-4289-89e8-1cf4b713e17e tempest-VolumesSnapshotTestJSON-1969201650 None] Create snapshot completed successfully
Oct 29 21:18:08.963711 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:09.041395 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Flow 'volume_create_manager' (143f40aa-43be-4e70-a0ef-8c0e1f13f891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:09.061265 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8942b68-7f01-4b58-bed1-6a8d43fa1a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:09.117169 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8942b68-7f01-4b58-bed1-6a8d43fa1a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1010211994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=90d2b0a2-6818-4371-9f3d-659dcbb81ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85f28183d1c94085a4bc93956d3dfe91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:09Z,use_quota=True,user_id='19d261119a004d6581158a17c3cbe5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:09.132707 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380f31ec-3086-4856-a0e8-24e6a3c02660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:09.146600 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380f31ec-3086-4856-a0e8-24e6a3c02660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:09.153065 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2f8904-3f65-422a-88f1-dd817967de13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:09.157848 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2f8904-3f65-422a-88f1-dd817967de13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d2b0a2-6818-4371-9f3d-659dcbb81ecc', 'volume_name': 'volume-90d2b0a2-6818-4371-9f3d-659dcbb81ecc', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:09.164951 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf18c123-767a-468a-bd2c-e7f509c56962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:09.170954 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf18c123-767a-468a-bd2c-e7f509c56962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:09.200717 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ed4e1c-df1c-421a-b42f-cb67c2842f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:09.202604 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Volume 90d2b0a2-6818-4371-9f3d-659dcbb81ecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d2b0a2-6818-4371-9f3d-659dcbb81ecc', 'volume_size': 1}
Oct 29 21:18:09.205190 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] creating volume 'volume-90d2b0a2-6818-4371-9f3d-659dcbb81ecc' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:18:09.206155 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:09.340710 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:09.341101 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:09.345082 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ed4e1c-df1c-421a-b42f-cb67c2842f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d2b0a2-6818-4371-9f3d-659dcbb81ecc', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:09.350989 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73529add-83ad-485b-9c6e-de82ad722c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:09.370772 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Volume volume-90d2b0a2-6818-4371-9f3d-659dcbb81ecc (90d2b0a2-6818-4371-9f3d-659dcbb81ecc): created successfully
Oct 29 21:18:09.376750 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73529add-83ad-485b-9c6e-de82ad722c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:09.385044 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Flow 'volume_create_manager' (143f40aa-43be-4e70-a0ef-8c0e1f13f891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:09.404162 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-3cce8c70-f5fa-4787-87d2-4a013573beb5 tempest-VolumesServicesTestJSON-1880661910 None] Created volume successfully.
Oct 29 21:18:09.917491 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:09.926412 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:09.968125 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Flow 'volume_create_manager' (d5dab82e-269d-4948-bb7b-401784396dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:09.974870 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bd14d5-40c8-48ce-9d44-aff4b6bf009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:09.983505 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=31,cinder:SELECT=64,cinder:INSERT=2,cinder:DELETE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:18:09.998189 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bd14d5-40c8-48ce-9d44-aff4b6bf009a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1088698634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ef92b0a5-725e-4db3-9ad5-ff29b171d7aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadc2e7f9183451c8e3fb3cb0542260c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:10Z,use_quota=True,user_id='a74bee24631b422b83253761c9bbec1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:10.005507 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfdecc8-0df8-4765-a40d-dbbdf9da2e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:10.009896 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cfdecc8-0df8-4765-a40d-dbbdf9da2e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:10.015145 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf416e0-d865-46ab-9a98-c45ac51c1f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:10.036025 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Flow 'volume_create_manager' (d2774f94-1b2c-4a86-8e5a-beffc1c1814b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:10.042485 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc10eed0-55ea-4eb0-b328-b8cdb6dcccf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:10.072385 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc10eed0-55ea-4eb0-b328-b8cdb6dcccf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1764725837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cea2c11b-d9ca-4e1c-a9f2-ffdf279f7a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10601894adb44985b208c3ab7ffa22c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0a1a748f-0fdd-4c1d-ae86-2560de031d4c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:10Z,use_quota=True,user_id='04bbe6295ba34150b3609466e42c8abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:10.085285 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f25b1fe-09e0-4b6d-b289-94348e10bdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:10.098261 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f25b1fe-09e0-4b6d-b289-94348e10bdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:10.103240 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6ffa2a-a6e3-4535-9ca6-e2907a3ffd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:10.107599 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6ffa2a-a6e3-4535-9ca6-e2907a3ffd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cea2c11b-d9ca-4e1c-a9f2-ffdf279f7a2a', 'volume_name': 'volume-cea2c11b-d9ca-4e1c-a9f2-ffdf279f7a2a', 'volume_size': 1, 'snapshot_id': '0a1a748f-0fdd-4c1d-ae86-2560de031d4c'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:10.113040 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac6b313-9965-4ae9-b2be-bc144cd5e4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:10.117477 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac6b313-9965-4ae9-b2be-bc144cd5e4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:10.122440 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87afd2c2-f473-4502-84b7-eb9b0df47dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:10.123756 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Volume cea2c11b-d9ca-4e1c-a9f2-ffdf279f7a2a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cea2c11b-d9ca-4e1c-a9f2-ffdf279f7a2a', 'volume_size': 1, 'snapshot_id': '0a1a748f-0fdd-4c1d-ae86-2560de031d4c'}
Oct 29 21:18:10.197402 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a472653a-32a3-4b17-9b6f-767e6315027e tempest-VolumesServicesTestJSON-1880661910 None] Acquiring lock "cinder-90d2b0a2-6818-4371-9f3d-659dcbb81ecc-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:10.235846 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] cloning volumes/volume-f6aa72e7-9cc5-4dd9-85f7-58feff1dc4da@snapshot-0a1a748f-0fdd-4c1d-ae86-2560de031d4c to volume-cea2c11b-d9ca-4e1c-a9f2-ffdf279f7a2a {{(pid=131780) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}}
Oct 29 21:18:10.236493 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:10.313229 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:10.408588 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a472653a-32a3-4b17-9b6f-767e6315027e tempest-VolumesServicesTestJSON-1880661910 None] Lock "cinder-90d2b0a2-6818-4371-9f3d-659dcbb81ecc-delete_volume" acquired by "delete_volume" :: waited 0.212s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:10.419835 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf416e0-d865-46ab-9a98-c45ac51c1f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef92b0a5-725e-4db3-9ad5-ff29b171d7aa', 'volume_name': 'volume-ef92b0a5-725e-4db3-9ad5-ff29b171d7aa', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93466aa070>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:10.427015 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4431184-945a-4638-9226-2b091cbb8fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:10.431678 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4431184-945a-4638-9226-2b091cbb8fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:10.437520 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a6ee67-47e5-40fd-93ff-5a14edbbb132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:10.438796 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Volume ef92b0a5-725e-4db3-9ad5-ff29b171d7aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef92b0a5-725e-4db3-9ad5-ff29b171d7aa', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93466aa070>}
Oct 29 21:18:10.440327 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Cloning ef92b0a5-725e-4db3-9ad5-ff29b171d7aa from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 21:18:10.441170 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:10.458111 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.017s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:10.476037 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 18, 10, 464243)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:18:10.476701 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:18:10.477269 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Found cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 29 21:18:10.507420 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 0.050s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:10.512111 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 21:18:10.542998 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:10.543184 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:10.586746 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87afd2c2-f473-4502-84b7-eb9b0df47dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea2c11b-d9ca-4e1c-a9f2-ffdf279f7a2a', 'volume_size': 1, 'snapshot_id': '0a1a748f-0fdd-4c1d-ae86-2560de031d4c'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:10.596223 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d02aa0-21db-43c8-b6d8-cf3725d7e05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:10.608321 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 18, 10, 559738)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:18:10.609044 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:18:10.610159 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Creating from source image-volume fbe0dd2e-351a-4779-844d-3c66baf14939 {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 29 21:18:10.614704 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a472653a-32a3-4b17-9b6f-767e6315027e tempest-VolumesServicesTestJSON-1880661910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:10.694484 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a472653a-32a3-4b17-9b6f-767e6315027e tempest-VolumesServicesTestJSON-1880661910 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:10.696873 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a472653a-32a3-4b17-9b6f-767e6315027e tempest-VolumesServicesTestJSON-1880661910 None] Volume volume-90d2b0a2-6818-4371-9f3d-659dcbb81ecc is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:10.713776 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a472653a-32a3-4b17-9b6f-767e6315027e tempest-VolumesServicesTestJSON-1880661910 None] deleting rbd volume volume-90d2b0a2-6818-4371-9f3d-659dcbb81ecc {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:10.718682 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Volume volume-cea2c11b-d9ca-4e1c-a9f2-ffdf279f7a2a (cea2c11b-d9ca-4e1c-a9f2-ffdf279f7a2a): created successfully
Oct 29 21:18:10.723769 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d02aa0-21db-43c8-b6d8-cf3725d7e05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:10.741912 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Flow 'volume_create_manager' (d2774f94-1b2c-4a86-8e5a-beffc1c1814b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:10.779187 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:10.927232 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] creating snapshot='volume-ef92b0a5-725e-4db3-9ad5-ff29b171d7aa.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 21:18:11.665716 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] cloning 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939@volume-ef92b0a5-725e-4db3-9ad5-ff29b171d7aa.clone_snap' to 'volume-ef92b0a5-725e-4db3-9ad5-ff29b171d7aa' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 21:18:11.706753 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-1ac7ce3f-5ac9-4d3f-ab18-2eb6660a41c2 tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-cea2c11b-d9ca-4e1c-a9f2-ffdf279f7a2a-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:11.796883 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-bedd2fc8-5f47-4acc-bc69-0134fad7ddd4 tempest-VolumesSnapshotTestJSON-1969201650 None] Created volume successfully.
Oct 29 21:18:11.810374 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-1ac7ce3f-5ac9-4d3f-ab18-2eb6660a41c2 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-cea2c11b-d9ca-4e1c-a9f2-ffdf279f7a2a-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:11.961647 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:11.965075 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:11.965543 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:12.001360 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 21:18:12.002037 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Marking volume ef92b0a5-725e-4db3-9ad5-ff29b171d7aa as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 21:18:12.060739 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to ef92b0a5-725e-4db3-9ad5-ff29b171d7aa. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 21:18:12.061161 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Creating volume glance metadata for volume ef92b0a5-725e-4db3-9ad5-ff29b171d7aa backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 21:18:12.115592 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-a472653a-32a3-4b17-9b6f-767e6315027e tempest-VolumesServicesTestJSON-1880661910 None] Created reservations ['eee703d0-e781-4185-95eb-988c1c6bea1e', '19cab0a6-6428-4cb6-a59a-171e92dff70b', '474f8983-7091-41bb-b79d-67fa14f07f70', '3e954f1a-7a09-4695-885a-371b26621ef6'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:12.143468 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1ac7ce3f-5ac9-4d3f-ab18-2eb6660a41c2 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:12.282881 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1ac7ce3f-5ac9-4d3f-ab18-2eb6660a41c2 tempest-VolumesSnapshotTestJSON-1969201650 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:12.299851 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1ac7ce3f-5ac9-4d3f-ab18-2eb6660a41c2 tempest-VolumesSnapshotTestJSON-1969201650 None] deleting rbd volume volume-cea2c11b-d9ca-4e1c-a9f2-ffdf279f7a2a {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:12.467473 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:DELETE=4,cinder:SELECT=72,cinder:UPDATE=19,cinder:INSERT=5 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:18:12.479758 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a6ee67-47e5-40fd-93ff-5a14edbbb132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef92b0a5-725e-4db3-9ad5-ff29b171d7aa', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93466aa070>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:12.496409 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a335209b-4350-4a3d-aeba-23c6042d9f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:12.543031 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Volume volume-ef92b0a5-725e-4db3-9ad5-ff29b171d7aa (ef92b0a5-725e-4db3-9ad5-ff29b171d7aa): created successfully
Oct 29 21:18:12.564796 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a335209b-4350-4a3d-aeba-23c6042d9f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:12.580933 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Flow 'volume_create_manager' (d5dab82e-269d-4948-bb7b-401784396dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:12.622922 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7edf47bf-8c1e-4186-8a34-fbfb84835b19 tempest-VolumesCloneTest-1283561851 None] Created volume successfully.
Oct 29 21:18:12.673890 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a472653a-32a3-4b17-9b6f-767e6315027e tempest-VolumesServicesTestJSON-1880661910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:12.773893 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a472653a-32a3-4b17-9b6f-767e6315027e tempest-VolumesServicesTestJSON-1880661910 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:12.837437 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-a472653a-32a3-4b17-9b6f-767e6315027e tempest-VolumesServicesTestJSON-1880661910 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:12.854596 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a472653a-32a3-4b17-9b6f-767e6315027e tempest-VolumesServicesTestJSON-1880661910 None] Deleted volume successfully.
Oct 29 21:18:12.880318 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a472653a-32a3-4b17-9b6f-767e6315027e tempest-VolumesServicesTestJSON-1880661910 None] Lock "cinder-90d2b0a2-6818-4371-9f3d-659dcbb81ecc-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:12.920602 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-1ac7ce3f-5ac9-4d3f-ab18-2eb6660a41c2 tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['56aee1e2-15d2-4174-9f05-ded2051ee65a', '6d3921a3-8c91-4554-a5e3-0ede486b814a', '715ca05e-ee1b-48ff-9ad7-b835a098e0a3', '2577b8e1-e3f7-4b09-bbfd-ac2712aa5856'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:13.020618 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1ac7ce3f-5ac9-4d3f-ab18-2eb6660a41c2 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:13.092978 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1ac7ce3f-5ac9-4d3f-ab18-2eb6660a41c2 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:13.150579 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1ac7ce3f-5ac9-4d3f-ab18-2eb6660a41c2 tempest-VolumesSnapshotTestJSON-1969201650 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:13.162249 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1ac7ce3f-5ac9-4d3f-ab18-2eb6660a41c2 tempest-VolumesSnapshotTestJSON-1969201650 None] Deleted volume successfully.
Oct 29 21:18:13.201009 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-1ac7ce3f-5ac9-4d3f-ab18-2eb6660a41c2 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-cea2c11b-d9ca-4e1c-a9f2-ffdf279f7a2a-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:13.548857 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f14c3cab-4bd3-45bc-b7dd-3ed0b285b50b tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-0a1a748f-0fdd-4c1d-ae86-2560de031d4c-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:13.575754 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f14c3cab-4bd3-45bc-b7dd-3ed0b285b50b tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-0a1a748f-0fdd-4c1d-ae86-2560de031d4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:13.580108 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f14c3cab-4bd3-45bc-b7dd-3ed0b285b50b tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:13.980845 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:14.047948 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Flow 'volume_create_manager' (0c04e14d-ed9a-4c94-9ae7-556052977be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:14.055143 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9dd2a6-648a-43c5-81a6-37c38b5f2171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:14.080923 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9dd2a6-648a-43c5-81a6-37c38b5f2171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1900030541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=03888c2f-c47d-49ac-ac45-dc6a50cfdc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadc2e7f9183451c8e3fb3cb0542260c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=ef92b0a5-725e-4db3-9ad5-ff29b171d7aa,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:14Z,use_quota=True,user_id='a74bee24631b422b83253761c9bbec1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:14.088446 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7097880-7bd2-4534-bcda-29cae97dcd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:14.093675 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7097880-7bd2-4534-bcda-29cae97dcd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:14.104181 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d0eb8c-751c-4a1f-92d7-5132cdd6a6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:14.131800 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d0eb8c-751c-4a1f-92d7-5132cdd6a6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '03888c2f-c47d-49ac-ac45-dc6a50cfdc23', 'volume_name': 'volume-03888c2f-c47d-49ac-ac45-dc6a50cfdc23', 'volume_size': 1, 'source_volid': 'ef92b0a5-725e-4db3-9ad5-ff29b171d7aa', 'source_volstatus': 'available'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:14.143086 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36301b2d-fee3-4bca-a9ca-7fd9e087f9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:14.152122 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36301b2d-fee3-4bca-a9ca-7fd9e087f9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:14.157283 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3df65c0-f1b9-4c89-9fb3-67a0d744afbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:14.159267 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Volume 03888c2f-c47d-49ac-ac45-dc6a50cfdc23: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-03888c2f-c47d-49ac-ac45-dc6a50cfdc23', 'volume_size': 1, 'source_volid': 'ef92b0a5-725e-4db3-9ad5-ff29b171d7aa', 'source_volstatus': 'available'}
Oct 29 21:18:14.178209 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:14.285931 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] creating snapshot='volume-03888c2f-c47d-49ac-ac45-dc6a50cfdc23.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 21:18:14.772361 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] cloning 'volume-ef92b0a5-725e-4db3-9ad5-ff29b171d7aa@volume-03888c2f-c47d-49ac-ac45-dc6a50cfdc23.clone_snap' to 'volume-03888c2f-c47d-49ac-ac45-dc6a50cfdc23' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 21:18:14.836704 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=56,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=14 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:18:15.062583 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:15.068097 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:15.068480 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:15.115271 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 21:18:15.116209 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Marking volume 03888c2f-c47d-49ac-ac45-dc6a50cfdc23 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 21:18:15.125334 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-f14c3cab-4bd3-45bc-b7dd-3ed0b285b50b tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['a252f5a2-aaca-4638-8d89-10a6e82a09ff', '844108a4-bc86-463f-9d36-788c018eabde', 'f59560ad-dd38-480c-8469-10aa56422e0d', '9e5bb944-d660-43f9-8aa8-36ce4656d92f'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:15.149873 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Copying metadata from source volume ef92b0a5-725e-4db3-9ad5-ff29b171d7aa to 03888c2f-c47d-49ac-ac45-dc6a50cfdc23. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:440}}
Oct 29 21:18:15.245092 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3df65c0-f1b9-4c89-9fb3-67a0d744afbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03888c2f-c47d-49ac-ac45-dc6a50cfdc23', 'volume_size': 1, 'source_volid': 'ef92b0a5-725e-4db3-9ad5-ff29b171d7aa', 'source_volstatus': 'available'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:15.251619 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5ace32-22e2-4b27-9947-6a812e97b77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:15.291367 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Volume volume-03888c2f-c47d-49ac-ac45-dc6a50cfdc23 (03888c2f-c47d-49ac-ac45-dc6a50cfdc23): created successfully
Oct 29 21:18:15.295762 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5ace32-22e2-4b27-9947-6a812e97b77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:15.303478 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Flow 'volume_create_manager' (0c04e14d-ed9a-4c94-9ae7-556052977be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:15.307720 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f14c3cab-4bd3-45bc-b7dd-3ed0b285b50b tempest-VolumesSnapshotTestJSON-1969201650 None] Delete snapshot completed successfully.
Oct 29 21:18:15.321598 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f14c3cab-4bd3-45bc-b7dd-3ed0b285b50b tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-0a1a748f-0fdd-4c1d-ae86-2560de031d4c-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:15.323384 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a237a587-8b2b-44b9-b103-c28493c88d12 tempest-VolumesCloneTest-1283561851 None] Created volume successfully.
Oct 29 21:18:15.932854 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9917ccb2-c823-4512-a5f1-88eb0262b71a tempest-AttachVolumeNegativeTest-2104062597 None] Acquiring lock "cinder-648d9275-b6e9-4edb-bc1e-85914451cce2-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:15.947657 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9917ccb2-c823-4512-a5f1-88eb0262b71a tempest-AttachVolumeNegativeTest-2104062597 None] Lock "cinder-648d9275-b6e9-4edb-bc1e-85914451cce2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:15.976481 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f51a848a-2e39-4a93-9dc6-1d4f7c2e2b93 tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-f6aa72e7-9cc5-4dd9-85f7-58feff1dc4da-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:16.002450 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f51a848a-2e39-4a93-9dc6-1d4f7c2e2b93 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-f6aa72e7-9cc5-4dd9-85f7-58feff1dc4da-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:16.078367 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9917ccb2-c823-4512-a5f1-88eb0262b71a tempest-AttachVolumeNegativeTest-2104062597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:16.216090 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9917ccb2-c823-4512-a5f1-88eb0262b71a tempest-AttachVolumeNegativeTest-2104062597 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:16.216524 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9917ccb2-c823-4512-a5f1-88eb0262b71a tempest-AttachVolumeNegativeTest-2104062597 None] Volume volume-648d9275-b6e9-4edb-bc1e-85914451cce2 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:16.232414 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9917ccb2-c823-4512-a5f1-88eb0262b71a tempest-AttachVolumeNegativeTest-2104062597 None] deleting rbd volume volume-648d9275-b6e9-4edb-bc1e-85914451cce2 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:16.310493 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f51a848a-2e39-4a93-9dc6-1d4f7c2e2b93 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:16.432718 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f51a848a-2e39-4a93-9dc6-1d4f7c2e2b93 tempest-VolumesSnapshotTestJSON-1969201650 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:16.433815 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f51a848a-2e39-4a93-9dc6-1d4f7c2e2b93 tempest-VolumesSnapshotTestJSON-1969201650 None] Volume volume-f6aa72e7-9cc5-4dd9-85f7-58feff1dc4da is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:16.445236 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f51a848a-2e39-4a93-9dc6-1d4f7c2e2b93 tempest-VolumesSnapshotTestJSON-1969201650 None] deleting rbd volume volume-f6aa72e7-9cc5-4dd9-85f7-58feff1dc4da {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:16.748036 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-9917ccb2-c823-4512-a5f1-88eb0262b71a tempest-AttachVolumeNegativeTest-2104062597 None] Created reservations ['68c08ff9-a583-4b9e-9dd9-92a28cca0293', 'a1933483-1e8a-4ce3-8ee1-9c4fef9b5f33', '3311b07d-308e-4587-a988-00f6c01ff581', '6d13a8dc-d7b5-481f-9ced-539973d937d9'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:16.910899 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9917ccb2-c823-4512-a5f1-88eb0262b71a tempest-AttachVolumeNegativeTest-2104062597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:16.982550 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=26,cinder:SELECT=53,cinder:DELETE=2,cinder:INSERT=19 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:18:16.988233 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9917ccb2-c823-4512-a5f1-88eb0262b71a tempest-AttachVolumeNegativeTest-2104062597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:17.100625 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-9917ccb2-c823-4512-a5f1-88eb0262b71a tempest-AttachVolumeNegativeTest-2104062597 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:17.137505 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-9917ccb2-c823-4512-a5f1-88eb0262b71a tempest-AttachVolumeNegativeTest-2104062597 None] Deleted volume successfully.
Oct 29 21:18:17.155874 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-f51a848a-2e39-4a93-9dc6-1d4f7c2e2b93 tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['f6dce216-eb3b-456e-a23c-dace094e0b23', '7af34e9a-e7d1-4c1d-b3a4-80829d959988', 'bb0ecd6e-9811-4ce6-8e8d-8199d9a0b471', 'aa1d592b-7408-48db-b788-5eff5eb08133'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:17.214271 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:17.259715 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Flow 'volume_create_manager' (e65b9e12-3ee6-4b49-b9c6-43d7cbf0bbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:17.273102 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1e1fc1-80f1-42b7-9f9e-dc14606e0905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:17.351137 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f51a848a-2e39-4a93-9dc6-1d4f7c2e2b93 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:17.444128 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1e1fc1-80f1-42b7-9f9e-dc14606e0905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-133900160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f9d9db4f-4e0e-4550-8c39-5c0ef4dac067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadc2e7f9183451c8e3fb3cb0542260c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:17Z,use_quota=True,user_id='a74bee24631b422b83253761c9bbec1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:17.451094 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538abdc4-5696-4774-9e36-db166e2d9293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:17.463584 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538abdc4-5696-4774-9e36-db166e2d9293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:17.479884 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d518ab-8c76-4434-9c76-7bbe69d08d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:17.486233 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d518ab-8c76-4434-9c76-7bbe69d08d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d9db4f-4e0e-4550-8c39-5c0ef4dac067', 'volume_name': 'volume-f9d9db4f-4e0e-4550-8c39-5c0ef4dac067', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:17.500355 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87c99bf-2459-48af-a46f-57b3217b7ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:17.505194 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87c99bf-2459-48af-a46f-57b3217b7ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:17.510204 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314b3ca8-fd37-4b70-a926-eb965f2c8e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:17.511472 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Volume f9d9db4f-4e0e-4550-8c39-5c0ef4dac067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d9db4f-4e0e-4550-8c39-5c0ef4dac067', 'volume_size': 1}
Oct 29 21:18:17.512063 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] creating volume 'volume-f9d9db4f-4e0e-4550-8c39-5c0ef4dac067' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:18:17.513659 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:17.592515 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-42f69a1c-ce10-4204-8e6f-5887829ca580 tempest-AttachVolumeNegativeTest-2104062597 None] Acquiring lock "cinder-3e2d09bb-2c91-470b-a1b9-7393e264eb22-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:17.598018 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f51a848a-2e39-4a93-9dc6-1d4f7c2e2b93 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:17.663770 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-f51a848a-2e39-4a93-9dc6-1d4f7c2e2b93 tempest-VolumesSnapshotTestJSON-1969201650 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:17.672336 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9917ccb2-c823-4512-a5f1-88eb0262b71a tempest-AttachVolumeNegativeTest-2104062597 None] Lock "cinder-648d9275-b6e9-4edb-bc1e-85914451cce2-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:17.685708 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:17.685939 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:17.690440 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314b3ca8-fd37-4b70-a926-eb965f2c8e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d9db4f-4e0e-4550-8c39-5c0ef4dac067', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:17.698295 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5bda5ea-10eb-4f94-a997-00e360c9ad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:17.726327 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f51a848a-2e39-4a93-9dc6-1d4f7c2e2b93 tempest-VolumesSnapshotTestJSON-1969201650 None] Deleted volume successfully.
Oct 29 21:18:17.736745 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-42f69a1c-ce10-4204-8e6f-5887829ca580 tempest-AttachVolumeNegativeTest-2104062597 None] Lock "cinder-3e2d09bb-2c91-470b-a1b9-7393e264eb22-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:17.757804 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Volume volume-f9d9db4f-4e0e-4550-8c39-5c0ef4dac067 (f9d9db4f-4e0e-4550-8c39-5c0ef4dac067): created successfully
Oct 29 21:18:17.762453 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5bda5ea-10eb-4f94-a997-00e360c9ad21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:17.771185 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Flow 'volume_create_manager' (e65b9e12-3ee6-4b49-b9c6-43d7cbf0bbe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:17.814966 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-42f69a1c-ce10-4204-8e6f-5887829ca580 tempest-AttachVolumeNegativeTest-2104062597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:17.908458 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-42f69a1c-ce10-4204-8e6f-5887829ca580 tempest-AttachVolumeNegativeTest-2104062597 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:17.909009 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-42f69a1c-ce10-4204-8e6f-5887829ca580 tempest-AttachVolumeNegativeTest-2104062597 None] Volume volume-3e2d09bb-2c91-470b-a1b9-7393e264eb22 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:17.919323 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-42f69a1c-ce10-4204-8e6f-5887829ca580 tempest-AttachVolumeNegativeTest-2104062597 None] deleting rbd volume volume-3e2d09bb-2c91-470b-a1b9-7393e264eb22 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:17.922750 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-93fe79fc-6981-4fea-96d6-8ced6c593f2d tempest-VolumesCloneTest-1283561851 None] Created volume successfully.
Oct 29 21:18:17.927073 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f51a848a-2e39-4a93-9dc6-1d4f7c2e2b93 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-f6aa72e7-9cc5-4dd9-85f7-58feff1dc4da-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:18.402725 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-42f69a1c-ce10-4204-8e6f-5887829ca580 tempest-AttachVolumeNegativeTest-2104062597 None] Created reservations ['820c015e-5806-4ef6-b363-714eb0756381', 'e1816691-4aa9-4645-bc64-d93a023f90d6', 'd2db33e6-8738-4bf1-bb69-78de3a321c74', '9c6970ce-be4e-4335-a458-397b5888e6cd'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:18.493146 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-8c55586b-f9ec-4c4d-a6c8-b001b4e63565 tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-e6a782a2-2e9c-4cdd-8fc4-c4876411f571-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:18.503968 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-42f69a1c-ce10-4204-8e6f-5887829ca580 tempest-AttachVolumeNegativeTest-2104062597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:18.601584 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-42f69a1c-ce10-4204-8e6f-5887829ca580 tempest-AttachVolumeNegativeTest-2104062597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:18.712017 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-42f69a1c-ce10-4204-8e6f-5887829ca580 tempest-AttachVolumeNegativeTest-2104062597 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:18.730312 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-42f69a1c-ce10-4204-8e6f-5887829ca580 tempest-AttachVolumeNegativeTest-2104062597 None] Deleted volume successfully.
Oct 29 21:18:18.752886 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-8c55586b-f9ec-4c4d-a6c8-b001b4e63565 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-e6a782a2-2e9c-4cdd-8fc4-c4876411f571-delete_snapshot" acquired by "delete_snapshot" :: waited 0.261s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:18.757354 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c55586b-f9ec-4c4d-a6c8-b001b4e63565 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:18.849556 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=49,cinder:INSERT=9,cinder:UPDATE=40,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:18:18.870810 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-42f69a1c-ce10-4204-8e6f-5887829ca580 tempest-AttachVolumeNegativeTest-2104062597 None] Lock "cinder-3e2d09bb-2c91-470b-a1b9-7393e264eb22-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:19.130055 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e2e07b17-7f91-4ce1-b442-4ba9fd316a02 tempest-AttachVolumeNegativeTest-2104062597 None] Acquiring lock "cinder-93c37ec6-3084-4796-8e73-96d84a9ea40a-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:19.152965 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e2e07b17-7f91-4ce1-b442-4ba9fd316a02 tempest-AttachVolumeNegativeTest-2104062597 None] Lock "cinder-93c37ec6-3084-4796-8e73-96d84a9ea40a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:19.248822 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e2e07b17-7f91-4ce1-b442-4ba9fd316a02 tempest-AttachVolumeNegativeTest-2104062597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:19.360236 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e2e07b17-7f91-4ce1-b442-4ba9fd316a02 tempest-AttachVolumeNegativeTest-2104062597 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:19.360665 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e2e07b17-7f91-4ce1-b442-4ba9fd316a02 tempest-AttachVolumeNegativeTest-2104062597 None] Volume volume-93c37ec6-3084-4796-8e73-96d84a9ea40a is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:19.389246 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e2e07b17-7f91-4ce1-b442-4ba9fd316a02 tempest-AttachVolumeNegativeTest-2104062597 None] deleting rbd volume volume-93c37ec6-3084-4796-8e73-96d84a9ea40a {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:19.451874 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:19.509783 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Flow 'volume_create_manager' (a8126d51-a57f-442d-91db-eb5b53b124e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:19.522082 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c6e522-eefe-4b8b-bc75-95e9cfb3df09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:19.560473 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c6e522-eefe-4b8b-bc75-95e9cfb3df09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-419586416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadc2e7f9183451c8e3fb3cb0542260c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=f9d9db4f-4e0e-4550-8c39-5c0ef4dac067,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:19Z,use_quota=True,user_id='a74bee24631b422b83253761c9bbec1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:19.572108 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f093b5-ab1a-4e8a-ae51-93a9d1a32d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:19.589433 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f093b5-ab1a-4e8a-ae51-93a9d1a32d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:19.615812 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce947f39-03c0-4b3d-8868-7f5c66daa733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:19.643815 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce947f39-03c0-4b3d-8868-7f5c66daa733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad', 'volume_name': 'volume-eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad', 'volume_size': 2, 'source_volid': 'f9d9db4f-4e0e-4550-8c39-5c0ef4dac067', 'source_volstatus': 'available'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:19.649932 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90975b82-dca4-48d2-9def-6a61002c0a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:19.657402 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90975b82-dca4-48d2-9def-6a61002c0a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:19.669329 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4af32ea-9215-407e-a3af-9a1714059919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:19.670928 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Volume eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad', 'volume_size': 2, 'source_volid': 'f9d9db4f-4e0e-4550-8c39-5c0ef4dac067', 'source_volstatus': 'available'}
Oct 29 21:18:19.690936 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:19.798275 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] creating snapshot='volume-eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 21:18:20.842467 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] cloning 'volume-f9d9db4f-4e0e-4550-8c39-5c0ef4dac067@volume-eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad.clone_snap' to 'volume-eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 21:18:20.957695 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-e2e07b17-7f91-4ce1-b442-4ba9fd316a02 tempest-AttachVolumeNegativeTest-2104062597 None] Created reservations ['70a81695-ecc0-4153-a094-b8421331588f', 'a5295251-c745-470f-bcff-5badac2f72ce', '51c8df6c-2581-458d-87f7-4e93878803e2', 'b3a79ceb-c170-4fda-bc38-9282d5225594'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:20.991464 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Volume volume-f9d9db4f-4e0e-4550-8c39-5c0ef4dac067 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:20.993958 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:20.997483 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:21.016080 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] resize volume 'volume-eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad' from 1 to 2 {{(pid=131780) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:812}}
Oct 29 21:18:21.017531 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:21.179182 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-8c55586b-f9ec-4c4d-a6c8-b001b4e63565 tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['e39903b8-eaa0-478c-a2ab-72febc6904ea', '553169b3-d0ed-4a86-86dd-34ae33b0a42f', '9da365f0-b6e5-43fb-937d-e78461bcc06b', 'a7a01c01-628a-4ca0-915d-1672faa9e087'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:21.230555 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 21:18:21.235423 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4af32ea-9215-407e-a3af-9a1714059919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad', 'volume_size': 2, 'source_volid': 'f9d9db4f-4e0e-4550-8c39-5c0ef4dac067', 'source_volstatus': 'available'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:21.241973 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1512b4-9ec2-4dae-b876-37bd1735594e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:21.265186 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Volume volume-eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad (eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad): created successfully
Oct 29 21:18:21.274469 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b1512b4-9ec2-4dae-b876-37bd1735594e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:21.288878 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Flow 'volume_create_manager' (a8126d51-a57f-442d-91db-eb5b53b124e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:21.340830 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7eee3e30-8d5f-497a-9697-73d60b3a4133 tempest-VolumesCloneTest-1283561851 None] Created volume successfully.
Oct 29 21:18:21.359696 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e2e07b17-7f91-4ce1-b442-4ba9fd316a02 tempest-AttachVolumeNegativeTest-2104062597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:21.441088 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e2e07b17-7f91-4ce1-b442-4ba9fd316a02 tempest-AttachVolumeNegativeTest-2104062597 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:21.566119 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-e2e07b17-7f91-4ce1-b442-4ba9fd316a02 tempest-AttachVolumeNegativeTest-2104062597 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:21.590302 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-e2e07b17-7f91-4ce1-b442-4ba9fd316a02 tempest-AttachVolumeNegativeTest-2104062597 None] Deleted volume successfully.
Oct 29 21:18:21.624995 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-8c55586b-f9ec-4c4d-a6c8-b001b4e63565 tempest-VolumesSnapshotTestJSON-1969201650 None] Delete snapshot completed successfully.
Oct 29 21:18:21.631824 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e2e07b17-7f91-4ce1-b442-4ba9fd316a02 tempest-AttachVolumeNegativeTest-2104062597 None] Lock "cinder-93c37ec6-3084-4796-8e73-96d84a9ea40a-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:21.633602 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-8c55586b-f9ec-4c4d-a6c8-b001b4e63565 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-e6a782a2-2e9c-4cdd-8fc4-c4876411f571-delete_snapshot" released by "delete_snapshot" :: held 2.881s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:21.670965 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-50e99296-b318-41e5-aedf-0b64344bae3b tempest-VolumesCloneTest-1283561851 None] Acquiring lock "cinder-eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:21.721731 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-50e99296-b318-41e5-aedf-0b64344bae3b tempest-VolumesCloneTest-1283561851 None] Lock "cinder-eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:21.882177 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-50e99296-b318-41e5-aedf-0b64344bae3b tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:22.008829 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-50e99296-b318-41e5-aedf-0b64344bae3b tempest-VolumesCloneTest-1283561851 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:22.021840 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-50e99296-b318-41e5-aedf-0b64344bae3b tempest-VolumesCloneTest-1283561851 None] deleting rbd volume volume-eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:22.026285 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ecf8db77-5a6d-48b2-89d9-b48daa0fb7fa tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-05cdf37d-5109-4a68-a702-417919e1f137-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:22.050049 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ecf8db77-5a6d-48b2-89d9-b48daa0fb7fa tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-05cdf37d-5109-4a68-a702-417919e1f137-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:22.114869 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecf8db77-5a6d-48b2-89d9-b48daa0fb7fa tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:22.232519 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecf8db77-5a6d-48b2-89d9-b48daa0fb7fa tempest-VolumesSnapshotTestJSON-1969201650 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:22.233976 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecf8db77-5a6d-48b2-89d9-b48daa0fb7fa tempest-VolumesSnapshotTestJSON-1969201650 None] Volume volume-05cdf37d-5109-4a68-a702-417919e1f137 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:22.257403 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecf8db77-5a6d-48b2-89d9-b48daa0fb7fa tempest-VolumesSnapshotTestJSON-1969201650 None] deleting rbd volume volume-05cdf37d-5109-4a68-a702-417919e1f137 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:22.375198 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-50e99296-b318-41e5-aedf-0b64344bae3b tempest-VolumesCloneTest-1283561851 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 21:18:22.405653 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-50e99296-b318-41e5-aedf-0b64344bae3b tempest-VolumesCloneTest-1283561851 None] Volume volume-f9d9db4f-4e0e-4550-8c39-5c0ef4dac067 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:22.406286 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-50e99296-b318-41e5-aedf-0b64344bae3b tempest-VolumesCloneTest-1283561851 None] deleting parent snapshot volume-eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 21:18:23.007360 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-50e99296-b318-41e5-aedf-0b64344bae3b tempest-VolumesCloneTest-1283561851 None] Created reservations ['b634718b-0262-4f98-a30f-782d59b677f0', '2313fb08-3740-4efa-9763-ad8b80ed9461', '07ef3719-0d46-4de9-9665-1ca2c45eddb9', 'c021d04d-6adb-4c16-a3e0-5d7d18c976b9'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:23.015147 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-ecf8db77-5a6d-48b2-89d9-b48daa0fb7fa tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['0a7483fd-8b9e-4680-95c3-64ac9aab94d8', '08765853-a5fc-4e19-8c58-69f2d706d565', '9b06330a-5296-472e-b540-703e5fe8363a', 'b10cdd36-40b0-4e7b-8e91-60eee503bfaa'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:23.074280 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=61,cinder:DELETE=2,cinder:INSERT=15,cinder:UPDATE=22 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:18:23.080799 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecf8db77-5a6d-48b2-89d9-b48daa0fb7fa tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:23.175108 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecf8db77-5a6d-48b2-89d9-b48daa0fb7fa tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:23.237893 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-ecf8db77-5a6d-48b2-89d9-b48daa0fb7fa tempest-VolumesSnapshotTestJSON-1969201650 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:23.249558 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-ecf8db77-5a6d-48b2-89d9-b48daa0fb7fa tempest-VolumesSnapshotTestJSON-1969201650 None] Deleted volume successfully.
Oct 29 21:18:23.265606 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=54,cinder:UPDATE=39,cinder:INSERT=4,cinder:DELETE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:18:23.296599 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ecf8db77-5a6d-48b2-89d9-b48daa0fb7fa tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-05cdf37d-5109-4a68-a702-417919e1f137-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:23.319142 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-50e99296-b318-41e5-aedf-0b64344bae3b tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:23.453973 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-50e99296-b318-41e5-aedf-0b64344bae3b tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:23.543140 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-50e99296-b318-41e5-aedf-0b64344bae3b tempest-VolumesCloneTest-1283561851 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:23.548322 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ce467b4a-f89a-4f05-a729-a0bf6971af07 tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-b6823076-879e-4467-9be0-aadbacfa9d45-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:23.552462 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-50e99296-b318-41e5-aedf-0b64344bae3b tempest-VolumesCloneTest-1283561851 None] Deleted volume successfully.
Oct 29 21:18:23.598805 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ce467b4a-f89a-4f05-a729-a0bf6971af07 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-b6823076-879e-4467-9be0-aadbacfa9d45-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:23.606465 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-50e99296-b318-41e5-aedf-0b64344bae3b tempest-VolumesCloneTest-1283561851 None] Lock "cinder-eab3e0eb-22b0-40e9-88ea-c7a33c2a81ad-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:23.656361 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ce467b4a-f89a-4f05-a729-a0bf6971af07 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:23.751458 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ce467b4a-f89a-4f05-a729-a0bf6971af07 tempest-VolumesSnapshotTestJSON-1969201650 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:23.763059 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ce467b4a-f89a-4f05-a729-a0bf6971af07 tempest-VolumesSnapshotTestJSON-1969201650 None] deleting rbd volume volume-b6823076-879e-4467-9be0-aadbacfa9d45 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:24.025958 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ce467b4a-f89a-4f05-a729-a0bf6971af07 tempest-VolumesSnapshotTestJSON-1969201650 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 21:18:24.079404 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ce467b4a-f89a-4f05-a729-a0bf6971af07 tempest-VolumesSnapshotTestJSON-1969201650 None] deleting parent snapshot volume-b6823076-879e-4467-9be0-aadbacfa9d45.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 21:18:24.989446 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-d44b212f-9bcb-4100-83cc-9905913093b6 tempest-VolumesCloneTest-1283561851 None] Acquiring lock "cinder-f9d9db4f-4e0e-4550-8c39-5c0ef4dac067-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:25.027047 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-d44b212f-9bcb-4100-83cc-9905913093b6 tempest-VolumesCloneTest-1283561851 None] Lock "cinder-f9d9db4f-4e0e-4550-8c39-5c0ef4dac067-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:25.108278 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d44b212f-9bcb-4100-83cc-9905913093b6 tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:25.183440 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d44b212f-9bcb-4100-83cc-9905913093b6 tempest-VolumesCloneTest-1283561851 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:25.184058 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d44b212f-9bcb-4100-83cc-9905913093b6 tempest-VolumesCloneTest-1283561851 None] Volume volume-f9d9db4f-4e0e-4550-8c39-5c0ef4dac067 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:25.194614 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d44b212f-9bcb-4100-83cc-9905913093b6 tempest-VolumesCloneTest-1283561851 None] deleting rbd volume volume-f9d9db4f-4e0e-4550-8c39-5c0ef4dac067 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:25.199169 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-ce467b4a-f89a-4f05-a729-a0bf6971af07 tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['5561335a-5f8b-43a9-b014-0150ee8f85c2', '550b6db3-73b1-4fab-978b-99b81d5bac69', 'aeaae963-5e28-4423-8dbc-9a3073128ec5', 'a33a7fa3-137b-4dbe-8b43-27542eaee089'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:25.321831 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ce467b4a-f89a-4f05-a729-a0bf6971af07 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:25.400865 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ce467b4a-f89a-4f05-a729-a0bf6971af07 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:25.478300 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-ce467b4a-f89a-4f05-a729-a0bf6971af07 tempest-VolumesSnapshotTestJSON-1969201650 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:25.504313 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-ce467b4a-f89a-4f05-a729-a0bf6971af07 tempest-VolumesSnapshotTestJSON-1969201650 None] Deleted volume successfully.
Oct 29 21:18:25.531047 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ce467b4a-f89a-4f05-a729-a0bf6971af07 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-b6823076-879e-4467-9be0-aadbacfa9d45-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:25.593367 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-d44b212f-9bcb-4100-83cc-9905913093b6 tempest-VolumesCloneTest-1283561851 None] Created reservations ['7068ed99-733d-4f17-b8ff-d99a842eeff6', 'c2b97306-8df1-4db9-8e76-7cf9d7709480', 'a812c4ec-0e7b-4ba4-9012-b66761f19f3d', 'acde1f7a-266e-435e-b999-46e8ed9ddb12'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:25.697389 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d44b212f-9bcb-4100-83cc-9905913093b6 tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:25.764538 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-d44b212f-9bcb-4100-83cc-9905913093b6 tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:25.844744 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-d44b212f-9bcb-4100-83cc-9905913093b6 tempest-VolumesCloneTest-1283561851 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:25.852014 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a6678e97-0cc0-49fe-afd9-60b8a8aee5e3 tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-5740aba7-0776-4cc8-befc-d09a9077ebb7-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:25.857629 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-d44b212f-9bcb-4100-83cc-9905913093b6 tempest-VolumesCloneTest-1283561851 None] Deleted volume successfully.
Oct 29 21:18:25.884340 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a6678e97-0cc0-49fe-afd9-60b8a8aee5e3 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-5740aba7-0776-4cc8-befc-d09a9077ebb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:25.886993 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a6678e97-0cc0-49fe-afd9-60b8a8aee5e3 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:25.994368 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-d44b212f-9bcb-4100-83cc-9905913093b6 tempest-VolumesCloneTest-1283561851 None] Lock "cinder-f9d9db4f-4e0e-4550-8c39-5c0ef4dac067-delete_volume" released by "delete_volume" :: held 0.970s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:26.395068 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-4547d427-5e72-499b-a40f-32003b3300e6 tempest-VolumesCloneTest-1283561851 None] Acquiring lock "cinder-03888c2f-c47d-49ac-ac45-dc6a50cfdc23-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:26.409623 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-4547d427-5e72-499b-a40f-32003b3300e6 tempest-VolumesCloneTest-1283561851 None] Lock "cinder-03888c2f-c47d-49ac-ac45-dc6a50cfdc23-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:26.475122 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4547d427-5e72-499b-a40f-32003b3300e6 tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:26.622643 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4547d427-5e72-499b-a40f-32003b3300e6 tempest-VolumesCloneTest-1283561851 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:26.634890 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4547d427-5e72-499b-a40f-32003b3300e6 tempest-VolumesCloneTest-1283561851 None] deleting rbd volume volume-03888c2f-c47d-49ac-ac45-dc6a50cfdc23 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:26.763037 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-a6678e97-0cc0-49fe-afd9-60b8a8aee5e3 tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['f2e5b865-95ac-41de-a837-ec0216084b11', '4776c279-7a7e-4a59-9710-9ff2d4aa8f08', '91f84f78-e758-4a0d-b3bb-eb1a3304d0c7', '48ee45d2-89ef-4f23-a814-306a52a8e574'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:26.874374 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a6678e97-0cc0-49fe-afd9-60b8a8aee5e3 tempest-VolumesSnapshotTestJSON-1969201650 None] Delete snapshot completed successfully.
Oct 29 21:18:26.885973 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a6678e97-0cc0-49fe-afd9-60b8a8aee5e3 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-5740aba7-0776-4cc8-befc-d09a9077ebb7-delete_snapshot" released by "delete_snapshot" :: held 1.002s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:27.004543 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4547d427-5e72-499b-a40f-32003b3300e6 tempest-VolumesCloneTest-1283561851 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 21:18:27.074309 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4547d427-5e72-499b-a40f-32003b3300e6 tempest-VolumesCloneTest-1283561851 None] deleting parent snapshot volume-03888c2f-c47d-49ac-ac45-dc6a50cfdc23.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 21:18:27.543381 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-17d470a3-2464-40e3-8ad8-6bc9380e5933 tempest-VolumesSnapshotTestJSON-1969201650 None] Acquiring lock "cinder-bde4424f-a811-49fc-b4f0-5d5fc9767766-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:27.591339 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-17d470a3-2464-40e3-8ad8-6bc9380e5933 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-bde4424f-a811-49fc-b4f0-5d5fc9767766-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:27.714917 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-17d470a3-2464-40e3-8ad8-6bc9380e5933 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:27.803540 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-17d470a3-2464-40e3-8ad8-6bc9380e5933 tempest-VolumesSnapshotTestJSON-1969201650 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:27.804244 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-17d470a3-2464-40e3-8ad8-6bc9380e5933 tempest-VolumesSnapshotTestJSON-1969201650 None] Volume volume-bde4424f-a811-49fc-b4f0-5d5fc9767766 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:27.812448 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-17d470a3-2464-40e3-8ad8-6bc9380e5933 tempest-VolumesSnapshotTestJSON-1969201650 None] deleting rbd volume volume-bde4424f-a811-49fc-b4f0-5d5fc9767766 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:27.815850 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-4547d427-5e72-499b-a40f-32003b3300e6 tempest-VolumesCloneTest-1283561851 None] Created reservations ['19763dc0-5faf-4f16-9989-758597bfee86', 'e98e9861-e22a-4332-a885-cb78ff02af49', '931b2901-ab22-44fd-bfe4-c3716643583e', '5af1e7f3-3654-403f-b610-a1e739aa1ba1'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:27.890039 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=59,cinder:UPDATE=31,cinder:INSERT=9,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:18:27.919712 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4547d427-5e72-499b-a40f-32003b3300e6 tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:28.023289 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4547d427-5e72-499b-a40f-32003b3300e6 tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:28.136857 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-4547d427-5e72-499b-a40f-32003b3300e6 tempest-VolumesCloneTest-1283561851 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:28.166775 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4547d427-5e72-499b-a40f-32003b3300e6 tempest-VolumesCloneTest-1283561851 None] Deleted volume successfully.
Oct 29 21:18:28.218198 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-4547d427-5e72-499b-a40f-32003b3300e6 tempest-VolumesCloneTest-1283561851 None] Lock "cinder-03888c2f-c47d-49ac-ac45-dc6a50cfdc23-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:28.260866 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-17d470a3-2464-40e3-8ad8-6bc9380e5933 tempest-VolumesSnapshotTestJSON-1969201650 None] Created reservations ['578d8904-16f6-493e-82ed-22c11c0b3c4b', 'dfefdd7a-72a7-4efc-8cb5-97bc9ada848c', '19fa2e49-30f7-4aa5-b97a-a3da89e83cb8', 'ed516a12-b895-4a22-b5d6-750c0bb88015'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:28.302727 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=49,cinder:UPDATE=42,cinder:DELETE=2,cinder:INSERT=7 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:18:28.337780 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-17d470a3-2464-40e3-8ad8-6bc9380e5933 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:28.422733 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-17d470a3-2464-40e3-8ad8-6bc9380e5933 tempest-VolumesSnapshotTestJSON-1969201650 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:28.495193 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-17d470a3-2464-40e3-8ad8-6bc9380e5933 tempest-VolumesSnapshotTestJSON-1969201650 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:28.499856 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-17d470a3-2464-40e3-8ad8-6bc9380e5933 tempest-VolumesSnapshotTestJSON-1969201650 None] Deleted volume successfully.
Oct 29 21:18:28.520216 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-17d470a3-2464-40e3-8ad8-6bc9380e5933 tempest-VolumesSnapshotTestJSON-1969201650 None] Lock "cinder-bde4424f-a811-49fc-b4f0-5d5fc9767766-delete_volume" released by "delete_volume" :: held 0.929s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:28.782537 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c9e63c51-d1a8-40e4-8f9f-c28861ae9f5d tempest-VolumesCloneTest-1283561851 None] Acquiring lock "cinder-ef92b0a5-725e-4db3-9ad5-ff29b171d7aa-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:28.800510 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c9e63c51-d1a8-40e4-8f9f-c28861ae9f5d tempest-VolumesCloneTest-1283561851 None] Lock "cinder-ef92b0a5-725e-4db3-9ad5-ff29b171d7aa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:28.899465 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c9e63c51-d1a8-40e4-8f9f-c28861ae9f5d tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:29.051775 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c9e63c51-d1a8-40e4-8f9f-c28861ae9f5d tempest-VolumesCloneTest-1283561851 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:29.060405 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c9e63c51-d1a8-40e4-8f9f-c28861ae9f5d tempest-VolumesCloneTest-1283561851 None] deleting rbd volume volume-ef92b0a5-725e-4db3-9ad5-ff29b171d7aa {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:29.400951 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c9e63c51-d1a8-40e4-8f9f-c28861ae9f5d tempest-VolumesCloneTest-1283561851 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 21:18:29.450502 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c9e63c51-d1a8-40e4-8f9f-c28861ae9f5d tempest-VolumesCloneTest-1283561851 None] deleting parent snapshot volume-ef92b0a5-725e-4db3-9ad5-ff29b171d7aa.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 21:18:30.670525 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-c9e63c51-d1a8-40e4-8f9f-c28861ae9f5d tempest-VolumesCloneTest-1283561851 None] Created reservations ['24a0034c-500b-4c0d-965c-feb7e626e8d4', '09477ae8-e52a-4b18-a6bd-6c0e167f1cb2', '3b50d152-a1c9-45cc-b58b-377a13c34a84', 'a6b5b6f5-cfc9-4483-a328-cb0688c62a76'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:30.688073 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:30.717873 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Flow 'volume_create_manager' (87344237-d219-42c0-8db1-928d66a07eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:30.730608 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8949c3ee-7e54-425d-8f24-a418dd7bd947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:30.768141 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8949c3ee-7e54-425d-8f24-a418dd7bd947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1418138079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=840d164c-ca65-476d-9c24-5d205bd24d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4f34a83db14e38a68ccb86a5e6856f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:29Z,use_quota=True,user_id='ff9385deea364318b84894a37bc68b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:30.774789 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5254ba8-32d3-45b6-8de6-ef091a29cf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:30.779410 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5254ba8-32d3-45b6-8de6-ef091a29cf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:30.785049 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9895b3f0-7d6c-4125-bf22-f610b817ff50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:30.789324 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9895b3f0-7d6c-4125-bf22-f610b817ff50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '840d164c-ca65-476d-9c24-5d205bd24d33', 'volume_name': 'volume-840d164c-ca65-476d-9c24-5d205bd24d33', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:30.795551 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eef0df7-15f4-4177-8651-24fe49a0283f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:30.799943 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eef0df7-15f4-4177-8651-24fe49a0283f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:30.806120 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01608add-57ae-43d6-891d-7fe69224257a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:30.807678 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Volume 840d164c-ca65-476d-9c24-5d205bd24d33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-840d164c-ca65-476d-9c24-5d205bd24d33', 'volume_size': 1}
Oct 29 21:18:30.808084 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] creating volume 'volume-840d164c-ca65-476d-9c24-5d205bd24d33' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:18:30.809248 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:30.908742 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:30.909409 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:30.914225 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01608add-57ae-43d6-891d-7fe69224257a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-840d164c-ca65-476d-9c24-5d205bd24d33', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:30.919408 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5956cfc4-508e-4c4c-816c-79d0a9a67052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:30.937356 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c9e63c51-d1a8-40e4-8f9f-c28861ae9f5d tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:30.999336 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Volume volume-840d164c-ca65-476d-9c24-5d205bd24d33 (840d164c-ca65-476d-9c24-5d205bd24d33): created successfully
Oct 29 21:18:31.019926 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5956cfc4-508e-4c4c-816c-79d0a9a67052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:31.028468 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Flow 'volume_create_manager' (87344237-d219-42c0-8db1-928d66a07eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:31.035323 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c9e63c51-d1a8-40e4-8f9f-c28861ae9f5d tempest-VolumesCloneTest-1283561851 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:31.142161 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-c9e63c51-d1a8-40e4-8f9f-c28861ae9f5d tempest-VolumesCloneTest-1283561851 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:31.157825 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-c9e63c51-d1a8-40e4-8f9f-c28861ae9f5d tempest-VolumesCloneTest-1283561851 None] Deleted volume successfully.
Oct 29 21:18:31.175160 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-346ffe92-00e0-465a-860f-33e329253753 tempest-VolumesTransfersV357Test-756921575 None] Created volume successfully.
Oct 29 21:18:31.222468 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c9e63c51-d1a8-40e4-8f9f-c28861ae9f5d tempest-VolumesCloneTest-1283561851 None] Lock "cinder-ef92b0a5-725e-4db3-9ad5-ff29b171d7aa-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:32.476690 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-343d9435-5145-4038-950c-45c76065ad80 tempest-VolumesTransfersV357Test-1634810680 None] Transfer volume completed successfully.
Oct 29 21:18:33.673716 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-0309ce5a-cb4d-47cd-b2e5-f7012724c89f tempest-VolumesTransfersV357Test-492276894 None] Acquiring lock "cinder-840d164c-ca65-476d-9c24-5d205bd24d33-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:33.708289 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-0309ce5a-cb4d-47cd-b2e5-f7012724c89f tempest-VolumesTransfersV357Test-492276894 None] Lock "cinder-840d164c-ca65-476d-9c24-5d205bd24d33-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:33.852088 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0309ce5a-cb4d-47cd-b2e5-f7012724c89f tempest-VolumesTransfersV357Test-492276894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:33.951456 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0309ce5a-cb4d-47cd-b2e5-f7012724c89f tempest-VolumesTransfersV357Test-492276894 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:33.952589 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0309ce5a-cb4d-47cd-b2e5-f7012724c89f tempest-VolumesTransfersV357Test-492276894 None] Volume volume-840d164c-ca65-476d-9c24-5d205bd24d33 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:33.962989 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0309ce5a-cb4d-47cd-b2e5-f7012724c89f tempest-VolumesTransfersV357Test-492276894 None] deleting rbd volume volume-840d164c-ca65-476d-9c24-5d205bd24d33 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:34.382008 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-0309ce5a-cb4d-47cd-b2e5-f7012724c89f tempest-VolumesTransfersV357Test-492276894 None] Created reservations ['26d46340-1b3b-4220-9a29-263219b027a4', 'f0cd9d62-66e4-4fdb-9286-75e8e07d6457', '7ac2e28a-ec65-46af-9ce5-b9f59d237a1f', 'eb3b4018-e037-429b-bd02-7b320fe555b1'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:34.493249 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0309ce5a-cb4d-47cd-b2e5-f7012724c89f tempest-VolumesTransfersV357Test-492276894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:34.600414 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0309ce5a-cb4d-47cd-b2e5-f7012724c89f tempest-VolumesTransfersV357Test-492276894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:34.674987 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-0309ce5a-cb4d-47cd-b2e5-f7012724c89f tempest-VolumesTransfersV357Test-492276894 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:34.681663 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-0309ce5a-cb4d-47cd-b2e5-f7012724c89f tempest-VolumesTransfersV357Test-492276894 None] Deleted volume successfully.
Oct 29 21:18:34.702208 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-0309ce5a-cb4d-47cd-b2e5-f7012724c89f tempest-VolumesTransfersV357Test-492276894 None] Lock "cinder-840d164c-ca65-476d-9c24-5d205bd24d33-delete_volume" released by "delete_volume" :: held 0.994s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:35.617772 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:35.687500 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Flow 'volume_create_manager' (5daa1d95-9f9c-40e0-89cc-62fb275360fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:35.714718 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b266e999-03d5-41ac-b91f-8e8f1508728c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:35.747796 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b266e999-03d5-41ac-b91f-8e8f1508728c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2134395570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6146c10a-1d7c-4de4-8829-5452f5a4c1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4f34a83db14e38a68ccb86a5e6856f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:36Z,use_quota=True,user_id='ff9385deea364318b84894a37bc68b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:35.761661 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09edf106-6b96-4c35-8407-55e9a4917d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:35.768929 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09edf106-6b96-4c35-8407-55e9a4917d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:35.788040 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444183de-8f3b-49ab-bda3-b5add2d7284e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:35.803701 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444183de-8f3b-49ab-bda3-b5add2d7284e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6146c10a-1d7c-4de4-8829-5452f5a4c1ef', 'volume_name': 'volume-6146c10a-1d7c-4de4-8829-5452f5a4c1ef', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:35.818171 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba04a41-e51e-4138-b9cb-df0ae43056c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:35.831479 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba04a41-e51e-4138-b9cb-df0ae43056c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:35.846160 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5347037b-0e98-4895-bd9a-ebe9e6970d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:35.849412 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Volume 6146c10a-1d7c-4de4-8829-5452f5a4c1ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6146c10a-1d7c-4de4-8829-5452f5a4c1ef', 'volume_size': 1}
Oct 29 21:18:35.850348 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] creating volume 'volume-6146c10a-1d7c-4de4-8829-5452f5a4c1ef' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:18:35.852010 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:36.027225 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:36.027619 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:36.031944 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5347037b-0e98-4895-bd9a-ebe9e6970d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6146c10a-1d7c-4de4-8829-5452f5a4c1ef', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:36.040761 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515de871-1bee-482d-963d-d4ff1af78590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:36.063746 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Volume volume-6146c10a-1d7c-4de4-8829-5452f5a4c1ef (6146c10a-1d7c-4de4-8829-5452f5a4c1ef): created successfully
Oct 29 21:18:36.067955 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515de871-1bee-482d-963d-d4ff1af78590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:36.073291 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Flow 'volume_create_manager' (5daa1d95-9f9c-40e0-89cc-62fb275360fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:36.098937 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-eff76948-7a34-44ca-bcc0-5f187dc2d761 tempest-VolumesTransfersV357Test-756921575 None] Created volume successfully.
Oct 29 21:18:36.162368 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:36.224077 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Flow 'volume_create_manager' (96af7cdf-5904-4598-84b3-7bef043b4196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:36.238144 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f113b034-aec5-4216-a14e-1f1f65c36f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:36.293103 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f113b034-aec5-4216-a14e-1f1f65c36f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-980111963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1968e5c3-e1c1-478c-9de5-08476b1b48b0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6c3d82dddaf548078bbc13ed7f5cdc2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:36Z,use_quota=True,user_id='49715498cb92404ba8a29cb2c261960e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:36.302265 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9513673a-e9b9-45d2-b38f-abc22d5ffcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:36.315185 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9513673a-e9b9-45d2-b38f-abc22d5ffcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:36.321656 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ade1af-8732-4a86-a43a-6e53c383468d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:36.327044 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ade1af-8732-4a86-a43a-6e53c383468d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1968e5c3-e1c1-478c-9de5-08476b1b48b0', 'volume_name': 'volume-1968e5c3-e1c1-478c-9de5-08476b1b48b0', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:36.336230 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceda2911-3528-4cbb-8af3-db8af31411c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:36.340864 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceda2911-3528-4cbb-8af3-db8af31411c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:36.345935 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b02a4b-7c2e-4201-85dc-c59b0456cdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:36.347728 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Volume 1968e5c3-e1c1-478c-9de5-08476b1b48b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1968e5c3-e1c1-478c-9de5-08476b1b48b0', 'volume_size': 1}
Oct 29 21:18:36.348191 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] creating volume 'volume-1968e5c3-e1c1-478c-9de5-08476b1b48b0' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:18:36.348915 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:36.411349 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:36.434493 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Flow 'volume_create_manager' (aec33b45-44fe-4bb0-961d-feb4a39ac12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:36.441790 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b665804-5aa7-4091-ab17-21e76c8c74dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:36.452316 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:36.453183 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:36.461145 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b02a4b-7c2e-4201-85dc-c59b0456cdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1968e5c3-e1c1-478c-9de5-08476b1b48b0', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:36.466447 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f7cf2d-406e-4007-b5a4-9058bf08cb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:36.493563 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b665804-5aa7-4091-ab17-21e76c8c74dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-88551205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b5bfdfe7-1fa4-49fd-8421-3c8f9915d831,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c19d871c0c6f42c78fb7aed38f1d012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:36Z,use_quota=True,user_id='d8e906cdcedd4ea3b99fa0fb9cb2ae4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:36.498859 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a445e7a-9fd8-4f47-a3a8-08682b3353aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:36.502943 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a445e7a-9fd8-4f47-a3a8-08682b3353aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:36.508225 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd3a811-5fa8-464c-9ca2-e8055f6089d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:36.512379 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd3a811-5fa8-464c-9ca2-e8055f6089d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5bfdfe7-1fa4-49fd-8421-3c8f9915d831', 'volume_name': 'volume-b5bfdfe7-1fa4-49fd-8421-3c8f9915d831', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:36.517088 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b540e271-8475-43fc-a7ee-c4af11fb9134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:36.521444 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b540e271-8475-43fc-a7ee-c4af11fb9134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:36.525951 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e77b8aa-c81f-4d39-a6f1-7a33c02de074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:36.527012 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Volume b5bfdfe7-1fa4-49fd-8421-3c8f9915d831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5bfdfe7-1fa4-49fd-8421-3c8f9915d831', 'volume_size': 1}
Oct 29 21:18:36.527412 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] creating volume 'volume-b5bfdfe7-1fa4-49fd-8421-3c8f9915d831' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:18:36.528058 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:36.575022 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Volume volume-1968e5c3-e1c1-478c-9de5-08476b1b48b0 (1968e5c3-e1c1-478c-9de5-08476b1b48b0): created successfully
Oct 29 21:18:36.583519 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f7cf2d-406e-4007-b5a4-9058bf08cb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:36.591631 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Flow 'volume_create_manager' (96af7cdf-5904-4598-84b3-7bef043b4196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:36.605047 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:36.605600 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:36.610670 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e77b8aa-c81f-4d39-a6f1-7a33c02de074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5bfdfe7-1fa4-49fd-8421-3c8f9915d831', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:36.615121 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bc7abb-16d3-4037-b6c1-4bc43ecc101b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:36.624494 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a5be5446-ce8b-486a-8047-054fcca62e3d tempest-VolumesTestJSON-1637142375 None] Created volume successfully.
Oct 29 21:18:36.629666 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Volume volume-b5bfdfe7-1fa4-49fd-8421-3c8f9915d831 (b5bfdfe7-1fa4-49fd-8421-3c8f9915d831): created successfully
Oct 29 21:18:36.634078 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bc7abb-16d3-4037-b6c1-4bc43ecc101b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:36.639493 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Flow 'volume_create_manager' (aec33b45-44fe-4bb0-961d-feb4a39ac12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:36.648531 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-00ef38be-b5f3-47ef-bdb9-384cea8ca5f9 tempest-VolumesListTestJSON-358750203 None] Created volume successfully.
Oct 29 21:18:37.149619 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-14d23449-b7d5-4afe-ba4d-c1f4f801d4e8 tempest-VolumesTransfersV357Test-492276894 None] Acquiring lock "cinder-6146c10a-1d7c-4de4-8829-5452f5a4c1ef-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:37.168044 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-14d23449-b7d5-4afe-ba4d-c1f4f801d4e8 tempest-VolumesTransfersV357Test-492276894 None] Lock "cinder-6146c10a-1d7c-4de4-8829-5452f5a4c1ef-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:37.175732 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=51,cinder:DELETE=4,cinder:INSERT=8,cinder:UPDATE=37 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:18:37.275351 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-14d23449-b7d5-4afe-ba4d-c1f4f801d4e8 tempest-VolumesTransfersV357Test-492276894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:37.387386 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-14d23449-b7d5-4afe-ba4d-c1f4f801d4e8 tempest-VolumesTransfersV357Test-492276894 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:37.387821 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-14d23449-b7d5-4afe-ba4d-c1f4f801d4e8 tempest-VolumesTransfersV357Test-492276894 None] Volume volume-6146c10a-1d7c-4de4-8829-5452f5a4c1ef is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:37.397169 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-14d23449-b7d5-4afe-ba4d-c1f4f801d4e8 tempest-VolumesTransfersV357Test-492276894 None] deleting rbd volume volume-6146c10a-1d7c-4de4-8829-5452f5a4c1ef {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:37.789212 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-14d23449-b7d5-4afe-ba4d-c1f4f801d4e8 tempest-VolumesTransfersV357Test-492276894 None] Created reservations ['16befc07-e2a6-4942-92c3-52aca26c00c0', 'a5389111-4cec-4127-a524-c23c2ecea11c', 'fa83836a-d50e-475b-95c4-030315608efe', 'cf903849-3d00-4796-a158-2df7fc6c89d6'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:37.922107 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-14d23449-b7d5-4afe-ba4d-c1f4f801d4e8 tempest-VolumesTransfersV357Test-492276894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:38.047228 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-14d23449-b7d5-4afe-ba4d-c1f4f801d4e8 tempest-VolumesTransfersV357Test-492276894 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:38.108127 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-14d23449-b7d5-4afe-ba4d-c1f4f801d4e8 tempest-VolumesTransfersV357Test-492276894 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:38.114422 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-14d23449-b7d5-4afe-ba4d-c1f4f801d4e8 tempest-VolumesTransfersV357Test-492276894 None] Deleted volume successfully.
Oct 29 21:18:38.144376 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-14d23449-b7d5-4afe-ba4d-c1f4f801d4e8 tempest-VolumesTransfersV357Test-492276894 None] Lock "cinder-6146c10a-1d7c-4de4-8829-5452f5a4c1ef-delete_volume" released by "delete_volume" :: held 0.976s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:38.155449 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:38.191050 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Flow 'volume_create_manager' (0c97b8f2-a617-4184-b419-68711bec1e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:38.202088 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d7be1a-b23d-4733-8088-a46240023154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:38.255510 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d7be1a-b23d-4733-8088-a46240023154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1438619550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=48f246ee-3ccc-4535-93c5-8c0d088795d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6c3d82dddaf548078bbc13ed7f5cdc2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:38Z,use_quota=True,user_id='49715498cb92404ba8a29cb2c261960e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:38.264792 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3bda853-378f-4f70-a54a-283dd6a0c3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:38.275066 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3bda853-378f-4f70-a54a-283dd6a0c3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:38.280097 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081a2a5c-af38-49e5-8101-01f0e63d8758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:38.294391 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081a2a5c-af38-49e5-8101-01f0e63d8758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f246ee-3ccc-4535-93c5-8c0d088795d5', 'volume_name': 'volume-48f246ee-3ccc-4535-93c5-8c0d088795d5', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:38.307138 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2810f92f-1a41-41a4-8d61-2e2078a3c57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:38.316635 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2810f92f-1a41-41a4-8d61-2e2078a3c57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:38.326185 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16ac192-4397-4214-acf5-fc9d70b358ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:38.327307 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Volume 48f246ee-3ccc-4535-93c5-8c0d088795d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f246ee-3ccc-4535-93c5-8c0d088795d5', 'volume_size': 1}
Oct 29 21:18:38.330153 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] creating volume 'volume-48f246ee-3ccc-4535-93c5-8c0d088795d5' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:18:38.330153 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:38.417621 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:38.454913 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Flow 'volume_create_manager' (f930e39c-8827-4029-b835-5c9d0c874761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:38.464299 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf64790-bf72-4292-b417-76db49175b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:38.469357 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=59,cinder:DELETE=5,cinder:UPDATE=29,cinder:INSERT=7 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:18:38.474830 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:38.475215 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:38.480357 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16ac192-4397-4214-acf5-fc9d70b358ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f246ee-3ccc-4535-93c5-8c0d088795d5', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:38.485238 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabc0578-9f1a-47b9-baea-ecd3aed79fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:38.505922 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf64790-bf72-4292-b417-76db49175b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-590733442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e4196c2c-55de-4200-a2b2-2e4be057e70f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c19d871c0c6f42c78fb7aed38f1d012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:38Z,use_quota=True,user_id='d8e906cdcedd4ea3b99fa0fb9cb2ae4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:38.513547 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8046445e-e354-4ede-baad-314fea3dc4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:38.519300 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8046445e-e354-4ede-baad-314fea3dc4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:38.525805 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498406e4-7c69-46cb-a6b8-ac0e66961624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:38.531163 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498406e4-7c69-46cb-a6b8-ac0e66961624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4196c2c-55de-4200-a2b2-2e4be057e70f', 'volume_name': 'volume-e4196c2c-55de-4200-a2b2-2e4be057e70f', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:38.537663 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6119142-895e-4f7b-afd0-578b4302f4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:38.541862 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6119142-895e-4f7b-afd0-578b4302f4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:38.547889 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0588c8a6-d099-484a-a713-f7972370bb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:38.549324 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Volume e4196c2c-55de-4200-a2b2-2e4be057e70f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4196c2c-55de-4200-a2b2-2e4be057e70f', 'volume_size': 1}
Oct 29 21:18:38.550506 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] creating volume 'volume-e4196c2c-55de-4200-a2b2-2e4be057e70f' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:18:38.551347 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:38.600669 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Volume volume-48f246ee-3ccc-4535-93c5-8c0d088795d5 (48f246ee-3ccc-4535-93c5-8c0d088795d5): created successfully
Oct 29 21:18:38.614842 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabc0578-9f1a-47b9-baea-ecd3aed79fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:38.625502 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Flow 'volume_create_manager' (0c97b8f2-a617-4184-b419-68711bec1e86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:38.641746 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-778dedfa-8f0b-46cd-a676-39925eac7d84 tempest-VolumesTestJSON-1637142375 None] Created volume successfully.
Oct 29 21:18:38.671267 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:38.671658 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:38.676406 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0588c8a6-d099-484a-a713-f7972370bb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4196c2c-55de-4200-a2b2-2e4be057e70f', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:38.682183 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053d8cad-8de0-48ed-b523-29e6b24f83cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:38.695298 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Volume volume-e4196c2c-55de-4200-a2b2-2e4be057e70f (e4196c2c-55de-4200-a2b2-2e4be057e70f): created successfully
Oct 29 21:18:38.701575 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053d8cad-8de0-48ed-b523-29e6b24f83cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:38.711465 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Flow 'volume_create_manager' (f930e39c-8827-4029-b835-5c9d0c874761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:38.726912 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-3b2ccc04-4ad9-4222-b358-8c972d8e71ca tempest-VolumesListTestJSON-358750203 None] Created volume successfully.
Oct 29 21:18:39.820450 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:39.841824 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Flow 'volume_create_manager' (1d782f14-4266-4f39-8134-613deb8c9bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:39.849623 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad94685c-1222-435c-91fb-431997010c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:39.875777 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad94685c-1222-435c-91fb-431997010c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1485679125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0aeca3fa-256e-42fd-87a5-2b60c2c04123,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6c3d82dddaf548078bbc13ed7f5cdc2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:40Z,use_quota=True,user_id='49715498cb92404ba8a29cb2c261960e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:39.881359 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87f90f4-b741-419f-bb32-cfef019f9734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:39.895111 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87f90f4-b741-419f-bb32-cfef019f9734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:39.902679 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6df279-2c26-4603-9b1e-cccc75e05e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:39.908508 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6df279-2c26-4603-9b1e-cccc75e05e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aeca3fa-256e-42fd-87a5-2b60c2c04123', 'volume_name': 'volume-0aeca3fa-256e-42fd-87a5-2b60c2c04123', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:39.915866 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71868fe3-7af7-49bd-8d62-c5f107325455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:39.919974 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71868fe3-7af7-49bd-8d62-c5f107325455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:39.927489 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f083086c-d268-42c2-b2bf-1869c15ea5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:39.938042 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Volume 0aeca3fa-256e-42fd-87a5-2b60c2c04123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aeca3fa-256e-42fd-87a5-2b60c2c04123', 'volume_size': 1}
Oct 29 21:18:39.938651 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] creating volume 'volume-0aeca3fa-256e-42fd-87a5-2b60c2c04123' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:18:39.939537 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:40.067139 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:40.092048 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Flow 'volume_create_manager' (38b6a831-b67a-4a20-8d54-6711119dcbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:40.100415 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce47af2e-ded7-4219-ac8a-b893e82f7543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:40.110237 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:40.110627 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:40.117061 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f083086c-d268-42c2-b2bf-1869c15ea5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aeca3fa-256e-42fd-87a5-2b60c2c04123', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:40.139172 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f944030e-71e6-4af6-a3d1-931677c74cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:40.193037 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce47af2e-ded7-4219-ac8a-b893e82f7543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1208668179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b18ff75c-5842-4298-8271-d25f98e9b5ae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c19d871c0c6f42c78fb7aed38f1d012b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:40Z,use_quota=True,user_id='d8e906cdcedd4ea3b99fa0fb9cb2ae4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:40.204355 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3b2dec-9439-476f-b4e4-a7bbbb8956fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:40.218519 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3b2dec-9439-476f-b4e4-a7bbbb8956fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:40.234379 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0674a659-dd84-482e-88db-33115ea56cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:40.243481 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0674a659-dd84-482e-88db-33115ea56cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18ff75c-5842-4298-8271-d25f98e9b5ae', 'volume_name': 'volume-b18ff75c-5842-4298-8271-d25f98e9b5ae', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:40.248276 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc47290-c94d-4e0c-a26d-d37267dc875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:40.266797 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc47290-c94d-4e0c-a26d-d37267dc875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:40.289035 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f7bc8f-ef52-499b-98b1-73cdc256c562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:40.292358 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Volume b18ff75c-5842-4298-8271-d25f98e9b5ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18ff75c-5842-4298-8271-d25f98e9b5ae', 'volume_size': 1}
Oct 29 21:18:40.292772 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] creating volume 'volume-b18ff75c-5842-4298-8271-d25f98e9b5ae' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:18:40.293431 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:40.357006 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Volume volume-0aeca3fa-256e-42fd-87a5-2b60c2c04123 (0aeca3fa-256e-42fd-87a5-2b60c2c04123): created successfully
Oct 29 21:18:40.363055 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f944030e-71e6-4af6-a3d1-931677c74cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:40.377823 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Flow 'volume_create_manager' (1d782f14-4266-4f39-8134-613deb8c9bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:40.396863 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b05be616-d307-4473-aa66-9f5e594f1c46 tempest-VolumesTestJSON-1637142375 None] Created volume successfully.
Oct 29 21:18:40.414646 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:40.415031 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:40.426623 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f7bc8f-ef52-499b-98b1-73cdc256c562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18ff75c-5842-4298-8271-d25f98e9b5ae', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:40.437508 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a2bb0f-3741-408a-8037-738d73efad63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:40.457877 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Volume volume-b18ff75c-5842-4298-8271-d25f98e9b5ae (b18ff75c-5842-4298-8271-d25f98e9b5ae): created successfully
Oct 29 21:18:40.463726 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a2bb0f-3741-408a-8037-738d73efad63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:40.478398 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Flow 'volume_create_manager' (38b6a831-b67a-4a20-8d54-6711119dcbfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:40.503593 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f7ca1bd1-5db2-412d-b4d6-7ca15667753a tempest-VolumesListTestJSON-358750203 None] Created volume successfully.
Oct 29 21:18:42.697013 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-0f14900d-5695-4518-a293-8f146f396ac4 tempest-VolumesTestJSON-1637142375 None] Acquiring lock "cinder-0aeca3fa-256e-42fd-87a5-2b60c2c04123-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:42.715348 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-0f14900d-5695-4518-a293-8f146f396ac4 tempest-VolumesTestJSON-1637142375 None] Lock "cinder-0aeca3fa-256e-42fd-87a5-2b60c2c04123-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:42.782467 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0f14900d-5695-4518-a293-8f146f396ac4 tempest-VolumesTestJSON-1637142375 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:42.836974 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0f14900d-5695-4518-a293-8f146f396ac4 tempest-VolumesTestJSON-1637142375 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:42.840148 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0f14900d-5695-4518-a293-8f146f396ac4 tempest-VolumesTestJSON-1637142375 None] Volume volume-0aeca3fa-256e-42fd-87a5-2b60c2c04123 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:42.850852 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0f14900d-5695-4518-a293-8f146f396ac4 tempest-VolumesTestJSON-1637142375 None] deleting rbd volume volume-0aeca3fa-256e-42fd-87a5-2b60c2c04123 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:43.321149 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-0f14900d-5695-4518-a293-8f146f396ac4 tempest-VolumesTestJSON-1637142375 None] Created reservations ['9fec9747-62b9-40e7-ba38-107fafc11f82', 'cfe0ed75-4a71-4158-9c63-94fc9586b5a7', '08058961-2e02-461b-a526-4076ceab7711', '6761bedc-ed6d-4771-b106-c669570e667d'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:43.437431 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0f14900d-5695-4518-a293-8f146f396ac4 tempest-VolumesTestJSON-1637142375 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:43.515095 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0f14900d-5695-4518-a293-8f146f396ac4 tempest-VolumesTestJSON-1637142375 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:43.622441 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-0f14900d-5695-4518-a293-8f146f396ac4 tempest-VolumesTestJSON-1637142375 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:43.634034 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-0f14900d-5695-4518-a293-8f146f396ac4 tempest-VolumesTestJSON-1637142375 None] Deleted volume successfully.
Oct 29 21:18:43.656751 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-0f14900d-5695-4518-a293-8f146f396ac4 tempest-VolumesTestJSON-1637142375 None] Lock "cinder-0aeca3fa-256e-42fd-87a5-2b60c2c04123-delete_volume" released by "delete_volume" :: held 0.941s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:44.034443 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-3cdf0a02-cdcf-401c-8a1a-a80a64ae8a8c tempest-VolumesTestJSON-1637142375 None] Acquiring lock "cinder-48f246ee-3ccc-4535-93c5-8c0d088795d5-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:44.062761 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-3cdf0a02-cdcf-401c-8a1a-a80a64ae8a8c tempest-VolumesTestJSON-1637142375 None] Lock "cinder-48f246ee-3ccc-4535-93c5-8c0d088795d5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:44.134930 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3cdf0a02-cdcf-401c-8a1a-a80a64ae8a8c tempest-VolumesTestJSON-1637142375 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:44.223188 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3cdf0a02-cdcf-401c-8a1a-a80a64ae8a8c tempest-VolumesTestJSON-1637142375 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:44.224128 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3cdf0a02-cdcf-401c-8a1a-a80a64ae8a8c tempest-VolumesTestJSON-1637142375 None] Volume volume-48f246ee-3ccc-4535-93c5-8c0d088795d5 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:44.235180 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3cdf0a02-cdcf-401c-8a1a-a80a64ae8a8c tempest-VolumesTestJSON-1637142375 None] deleting rbd volume volume-48f246ee-3ccc-4535-93c5-8c0d088795d5 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:44.625699 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-3cdf0a02-cdcf-401c-8a1a-a80a64ae8a8c tempest-VolumesTestJSON-1637142375 None] Created reservations ['2ff521ad-b393-4056-ab50-7680aa666e9e', 'd218e62f-68bf-4284-b665-cd44f6a63924', 'b66fddb9-c7a2-490f-b2a6-926d153e7ccb', 'bfa9fb92-9d92-4e03-bd8e-b6c5f46b55c5'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:44.736567 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3cdf0a02-cdcf-401c-8a1a-a80a64ae8a8c tempest-VolumesTestJSON-1637142375 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:44.807667 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3cdf0a02-cdcf-401c-8a1a-a80a64ae8a8c tempest-VolumesTestJSON-1637142375 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:44.949587 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-3cdf0a02-cdcf-401c-8a1a-a80a64ae8a8c tempest-VolumesTestJSON-1637142375 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:44.958012 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-3cdf0a02-cdcf-401c-8a1a-a80a64ae8a8c tempest-VolumesTestJSON-1637142375 None] Deleted volume successfully.
Oct 29 21:18:44.978078 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-3cdf0a02-cdcf-401c-8a1a-a80a64ae8a8c tempest-VolumesTestJSON-1637142375 None] Lock "cinder-48f246ee-3ccc-4535-93c5-8c0d088795d5-delete_volume" released by "delete_volume" :: held 0.915s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:45.302780 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-442bc430-a14e-429d-be1f-7b5f225239b7 tempest-VolumesTestJSON-1637142375 None] Acquiring lock "cinder-1968e5c3-e1c1-478c-9de5-08476b1b48b0-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:45.317039 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-442bc430-a14e-429d-be1f-7b5f225239b7 tempest-VolumesTestJSON-1637142375 None] Lock "cinder-1968e5c3-e1c1-478c-9de5-08476b1b48b0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:45.409854 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-442bc430-a14e-429d-be1f-7b5f225239b7 tempest-VolumesTestJSON-1637142375 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:45.505517 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-442bc430-a14e-429d-be1f-7b5f225239b7 tempest-VolumesTestJSON-1637142375 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:45.505952 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-442bc430-a14e-429d-be1f-7b5f225239b7 tempest-VolumesTestJSON-1637142375 None] Volume volume-1968e5c3-e1c1-478c-9de5-08476b1b48b0 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:45.514403 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-442bc430-a14e-429d-be1f-7b5f225239b7 tempest-VolumesTestJSON-1637142375 None] deleting rbd volume volume-1968e5c3-e1c1-478c-9de5-08476b1b48b0 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:45.996224 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-442bc430-a14e-429d-be1f-7b5f225239b7 tempest-VolumesTestJSON-1637142375 None] Created reservations ['89c9acb5-27c8-4618-ae7d-f5ce45943236', '43144110-0bbe-42d2-b884-3e99a9f419c0', '7d8b54b5-088c-4717-9205-68c7598f1d16', '0543cfa5-79dc-4124-b508-631d862664b2'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:46.081706 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=55,cinder:INSERT=8,cinder:UPDATE=33,cinder:DELETE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:18:46.125322 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-442bc430-a14e-429d-be1f-7b5f225239b7 tempest-VolumesTestJSON-1637142375 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:46.243797 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-06804c5a-7603-47bb-9f9b-3b38c0bb5edf tempest-VolumesListTestJSON-358750203 None] Acquiring lock "cinder-b18ff75c-5842-4298-8271-d25f98e9b5ae-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:46.248420 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-442bc430-a14e-429d-be1f-7b5f225239b7 tempest-VolumesTestJSON-1637142375 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:46.312690 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-442bc430-a14e-429d-be1f-7b5f225239b7 tempest-VolumesTestJSON-1637142375 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:46.322420 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-442bc430-a14e-429d-be1f-7b5f225239b7 tempest-VolumesTestJSON-1637142375 None] Deleted volume successfully.
Oct 29 21:18:46.328956 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-06804c5a-7603-47bb-9f9b-3b38c0bb5edf tempest-VolumesListTestJSON-358750203 None] Lock "cinder-b18ff75c-5842-4298-8271-d25f98e9b5ae-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:46.345619 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-442bc430-a14e-429d-be1f-7b5f225239b7 tempest-VolumesTestJSON-1637142375 None] Lock "cinder-1968e5c3-e1c1-478c-9de5-08476b1b48b0-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:46.347576 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=59,cinder:DELETE=2,cinder:UPDATE=34,cinder:INSERT=5 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:18:46.386331 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-06804c5a-7603-47bb-9f9b-3b38c0bb5edf tempest-VolumesListTestJSON-358750203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:46.488992 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-06804c5a-7603-47bb-9f9b-3b38c0bb5edf tempest-VolumesListTestJSON-358750203 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:46.489613 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-06804c5a-7603-47bb-9f9b-3b38c0bb5edf tempest-VolumesListTestJSON-358750203 None] Volume volume-b18ff75c-5842-4298-8271-d25f98e9b5ae is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:46.502144 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-06804c5a-7603-47bb-9f9b-3b38c0bb5edf tempest-VolumesListTestJSON-358750203 None] deleting rbd volume volume-b18ff75c-5842-4298-8271-d25f98e9b5ae {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:46.855226 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-06804c5a-7603-47bb-9f9b-3b38c0bb5edf tempest-VolumesListTestJSON-358750203 None] Created reservations ['6faaceed-591e-4ef3-8120-cd8008e1bc01', 'b37dd03f-316c-472e-bd74-4ef01cb7b1ff', '84f9ff10-9f27-4832-b867-26b87f9f349a', 'a0ce03eb-d241-4f48-a42c-dbb940913315'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:46.937112 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-06804c5a-7603-47bb-9f9b-3b38c0bb5edf tempest-VolumesListTestJSON-358750203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:47.007269 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-06804c5a-7603-47bb-9f9b-3b38c0bb5edf tempest-VolumesListTestJSON-358750203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:47.065916 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-06804c5a-7603-47bb-9f9b-3b38c0bb5edf tempest-VolumesListTestJSON-358750203 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:47.071039 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-06804c5a-7603-47bb-9f9b-3b38c0bb5edf tempest-VolumesListTestJSON-358750203 None] Deleted volume successfully.
Oct 29 21:18:47.106513 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-06804c5a-7603-47bb-9f9b-3b38c0bb5edf tempest-VolumesListTestJSON-358750203 None] Lock "cinder-b18ff75c-5842-4298-8271-d25f98e9b5ae-delete_volume" released by "delete_volume" :: held 0.777s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:47.381270 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-975a958f-8d8f-49a0-82aa-d18a9468b17c tempest-VolumesListTestJSON-358750203 None] Acquiring lock "cinder-e4196c2c-55de-4200-a2b2-2e4be057e70f-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:47.401723 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-975a958f-8d8f-49a0-82aa-d18a9468b17c tempest-VolumesListTestJSON-358750203 None] Lock "cinder-e4196c2c-55de-4200-a2b2-2e4be057e70f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:47.475410 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-975a958f-8d8f-49a0-82aa-d18a9468b17c tempest-VolumesListTestJSON-358750203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:47.551562 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-975a958f-8d8f-49a0-82aa-d18a9468b17c tempest-VolumesListTestJSON-358750203 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:47.553355 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-975a958f-8d8f-49a0-82aa-d18a9468b17c tempest-VolumesListTestJSON-358750203 None] Volume volume-e4196c2c-55de-4200-a2b2-2e4be057e70f is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:47.563457 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-975a958f-8d8f-49a0-82aa-d18a9468b17c tempest-VolumesListTestJSON-358750203 None] deleting rbd volume volume-e4196c2c-55de-4200-a2b2-2e4be057e70f {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:47.872881 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-975a958f-8d8f-49a0-82aa-d18a9468b17c tempest-VolumesListTestJSON-358750203 None] Created reservations ['199a0f31-6b25-4b96-a0d4-8b09bae2496f', '4dfec17d-8d2b-4c9c-ab9f-c03f04903538', '66270bcc-8e2f-43d8-8a31-cba8fe1c31ae', '7f618692-10e3-4141-86b9-e3efa6661470'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:47.925876 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:18:47.949034 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Flow 'volume_create_manager' (aef89847-e0f6-4811-9009-f7698c20a500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:47.955758 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64077c41-e18c-4b3c-912f-6c2ee2252ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:48.007850 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64077c41-e18c-4b3c-912f-6c2ee2252ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-925637450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=157a64a7-0797-4ad6-bbc0-05dd25668379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4e4f30c260948efa2370c51353d48d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:18:48Z,use_quota=True,user_id='4f0a921d2a60482ca47fed07daf2e9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:48.013828 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f78064-ba18-4521-8747-aaadb123af6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:48.018058 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f78064-ba18-4521-8747-aaadb123af6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:48.023173 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f07aab-2e4f-4b2b-9f60-e3c15feefe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:48.028282 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f07aab-2e4f-4b2b-9f60-e3c15feefe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '157a64a7-0797-4ad6-bbc0-05dd25668379', 'volume_name': 'volume-157a64a7-0797-4ad6-bbc0-05dd25668379', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:48.034371 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200c48bc-3bd6-46cc-ae1b-55edf874f54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:48.038564 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200c48bc-3bd6-46cc-ae1b-55edf874f54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:48.043146 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24903159-483e-4210-9b6f-9a5a7c1735f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:48.047335 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Volume 157a64a7-0797-4ad6-bbc0-05dd25668379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-157a64a7-0797-4ad6-bbc0-05dd25668379', 'volume_size': 1}
Oct 29 21:18:48.047748 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] creating volume 'volume-157a64a7-0797-4ad6-bbc0-05dd25668379' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:18:48.048863 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:48.099966 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-975a958f-8d8f-49a0-82aa-d18a9468b17c tempest-VolumesListTestJSON-358750203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:48.144812 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:18:48.145348 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:18:48.150375 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24903159-483e-4210-9b6f-9a5a7c1735f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-157a64a7-0797-4ad6-bbc0-05dd25668379', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:48.155377 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26165757-4eca-4f97-aa84-0a395e2b2646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:18:48.160323 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-975a958f-8d8f-49a0-82aa-d18a9468b17c tempest-VolumesListTestJSON-358750203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:48.208110 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-975a958f-8d8f-49a0-82aa-d18a9468b17c tempest-VolumesListTestJSON-358750203 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:48.213870 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-975a958f-8d8f-49a0-82aa-d18a9468b17c tempest-VolumesListTestJSON-358750203 None] Deleted volume successfully.
Oct 29 21:18:48.222800 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Volume volume-157a64a7-0797-4ad6-bbc0-05dd25668379 (157a64a7-0797-4ad6-bbc0-05dd25668379): created successfully
Oct 29 21:18:48.227315 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26165757-4eca-4f97-aa84-0a395e2b2646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:18:48.234712 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Flow 'volume_create_manager' (aef89847-e0f6-4811-9009-f7698c20a500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:18:48.250532 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-975a958f-8d8f-49a0-82aa-d18a9468b17c tempest-VolumesListTestJSON-358750203 None] Lock "cinder-e4196c2c-55de-4200-a2b2-2e4be057e70f-delete_volume" released by "delete_volume" :: held 0.849s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:18:48.253261 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-05e2cdb4-08b7-43b2-b73c-b4352d54a013 tempest-VolumesActionsTest-1690945690 None] Created volume successfully.
Oct 29 21:18:48.571484 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-5d113362-a265-4d04-ae4b-8b7e3a53e2e3 tempest-VolumesListTestJSON-358750203 None] Acquiring lock "cinder-b5bfdfe7-1fa4-49fd-8421-3c8f9915d831-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:18:48.588412 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-5d113362-a265-4d04-ae4b-8b7e3a53e2e3 tempest-VolumesListTestJSON-358750203 None] Lock "cinder-b5bfdfe7-1fa4-49fd-8421-3c8f9915d831-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:18:48.636189 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5d113362-a265-4d04-ae4b-8b7e3a53e2e3 tempest-VolumesListTestJSON-358750203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:48.693397 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5d113362-a265-4d04-ae4b-8b7e3a53e2e3 tempest-VolumesListTestJSON-358750203 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:18:48.693874 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5d113362-a265-4d04-ae4b-8b7e3a53e2e3 tempest-VolumesListTestJSON-358750203 None] Volume volume-b5bfdfe7-1fa4-49fd-8421-3c8f9915d831 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:18:48.698324 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5d113362-a265-4d04-ae4b-8b7e3a53e2e3 tempest-VolumesListTestJSON-358750203 None] deleting rbd volume volume-b5bfdfe7-1fa4-49fd-8421-3c8f9915d831 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:18:49.027299 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-5d113362-a265-4d04-ae4b-8b7e3a53e2e3 tempest-VolumesListTestJSON-358750203 None] Created reservations ['aa5af295-d61e-44ed-b330-bdb80d5c2c30', '5a4b6f08-71f4-4a7e-8ed9-7c56a809a94b', '96920da4-a3d6-4248-b033-deb540be22ec', '64fcf0eb-b58f-4b94-a7c1-ddead70d5b9a'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:18:49.153491 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5d113362-a265-4d04-ae4b-8b7e3a53e2e3 tempest-VolumesListTestJSON-358750203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:49.234947 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5d113362-a265-4d04-ae4b-8b7e3a53e2e3 tempest-VolumesListTestJSON-358750203 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:18:49.326908 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-5d113362-a265-4d04-ae4b-8b7e3a53e2e3 tempest-VolumesListTestJSON-358750203 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:18:49.339016 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-5d113362-a265-4d04-ae4b-8b7e3a53e2e3 tempest-VolumesListTestJSON-358750203 None] Deleted volume successfully.
Oct 29 21:18:49.365323 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-5d113362-a265-4d04-ae4b-8b7e3a53e2e3 tempest-VolumesListTestJSON-358750203 None] Lock "cinder-b5bfdfe7-1fa4-49fd-8421-3c8f9915d831-delete_volume" released by "delete_volume" :: held 0.777s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:19:01.394941 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:19:01.395750 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:19:01.454731 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:19:01.537974 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:19:03.985232 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=37,cinder:INSERT=6,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:19:07.260725 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:19:07.308826 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Flow 'volume_create_manager' (e773d6f7-b0ab-4604-acbf-bc90adf98403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:19:07.323977 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37503b6-1f4b-4b8d-8262-f7308434562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:07.342999 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37503b6-1f4b-4b8d-8262-f7308434562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-372181648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=53975089-e27f-40d6-82a2-af7e36d6fbfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1eca42e66ec4ad1b747ef6027e894df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:19:07Z,use_quota=True,user_id='1254ce210eae494b8c2bfc925b9978c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:07.350560 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d1f88e-cfcc-4bc9-9898-dc13307b4e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:07.356773 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d1f88e-cfcc-4bc9-9898-dc13307b4e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:07.364938 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ddffebc-fe5c-4465-a8c9-f872f9620de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:07.517960 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ddffebc-fe5c-4465-a8c9-f872f9620de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '53975089-e27f-40d6-82a2-af7e36d6fbfd', 'volume_name': 'volume-53975089-e27f-40d6-82a2-af7e36d6fbfd', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9346911f40>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:07.528996 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c85474b-65b6-49b2-93ae-037102f6b34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:07.539492 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c85474b-65b6-49b2-93ae-037102f6b34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:07.557630 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb63d93c-4537-4e29-acb1-0d1d6174718b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:07.560623 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Volume 53975089-e27f-40d6-82a2-af7e36d6fbfd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-53975089-e27f-40d6-82a2-af7e36d6fbfd', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9346911f40>}
Oct 29 21:19:07.561782 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Cloning 53975089-e27f-40d6-82a2-af7e36d6fbfd from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 21:19:07.564023 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:19:07.583947 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.019s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:19:07.609516 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 19, 7, 597397)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:19:07.612526 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:19:07.613557 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Found cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 29 21:19:07.624214 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 0.041s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:19:07.626014 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 21:19:07.644202 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 19, 7, 637306)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:19:07.645996 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:19:07.646948 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Creating from source image-volume fbe0dd2e-351a-4779-844d-3c66baf14939 {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 29 21:19:07.686272 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:19:07.823347 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] creating snapshot='volume-53975089-e27f-40d6-82a2-af7e36d6fbfd.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 21:19:08.639730 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] cloning 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939@volume-53975089-e27f-40d6-82a2-af7e36d6fbfd.clone_snap' to 'volume-53975089-e27f-40d6-82a2-af7e36d6fbfd' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 21:19:08.903760 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:19:08.905155 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:19:08.906396 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:19:08.936439 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 21:19:08.937331 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Marking volume 53975089-e27f-40d6-82a2-af7e36d6fbfd as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 21:19:08.952643 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to 53975089-e27f-40d6-82a2-af7e36d6fbfd. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 21:19:08.953136 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Creating volume glance metadata for volume 53975089-e27f-40d6-82a2-af7e36d6fbfd backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 21:19:09.005217 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:DELETE=3,cinder:UPDATE=33,cinder:SELECT=56,cinder:INSERT=8 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:19:09.169291 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb63d93c-4537-4e29-acb1-0d1d6174718b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53975089-e27f-40d6-82a2-af7e36d6fbfd', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9346911f40>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:09.178983 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a410a84-d1e8-4d24-a391-21463bbf3c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:09.212902 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Volume volume-53975089-e27f-40d6-82a2-af7e36d6fbfd (53975089-e27f-40d6-82a2-af7e36d6fbfd): created successfully
Oct 29 21:19:09.241871 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a410a84-d1e8-4d24-a391-21463bbf3c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:09.258680 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Flow 'volume_create_manager' (e773d6f7-b0ab-4604-acbf-bc90adf98403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:19:09.282601 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-ecc2c4a4-fd9e-4513-9443-d15b652b2e4e tempest-TestVolumeBootPattern-1121030847 None] Created volume successfully.
Oct 29 21:19:10.024893 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8f1e0402-58bc-4411-8659-cc27a2921c4b tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:19:10.428472 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f23e07f5-0f27-4623-9ced-c73dfb120bf6 tempest-VolumesActionsTest-1690945690 None] Acquiring lock "cinder-157a64a7-0797-4ad6-bbc0-05dd25668379" by "attach_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:19:10.445010 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f23e07f5-0f27-4623-9ced-c73dfb120bf6 tempest-VolumesActionsTest-1690945690 None] Lock "cinder-157a64a7-0797-4ad6-bbc0-05dd25668379" acquired by "attach_volume" :: waited 0.015s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:19:10.527310 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f23e07f5-0f27-4623-9ced-c73dfb120bf6 tempest-VolumesActionsTest-1690945690 None] Attaching volume 157a64a7-0797-4ad6-bbc0-05dd25668379 to instance fe3541b7-23c4-486b-923c-1c28b40b5c26 at mountpoint /dev/sdb on host None.
Oct 29 21:19:10.584462 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f23e07f5-0f27-4623-9ced-c73dfb120bf6 tempest-VolumesActionsTest-1690945690 None] Attach volume completed successfully.
Oct 29 21:19:10.602422 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f23e07f5-0f27-4623-9ced-c73dfb120bf6 tempest-VolumesActionsTest-1690945690 None] Lock "cinder-157a64a7-0797-4ad6-bbc0-05dd25668379" released by "attach_volume" :: held 0.159s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:19:10.878022 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-8e08af43-cad5-4e24-af4b-553e28291c67 tempest-VolumesActionsTest-1690945690 None] Acquiring lock "cinder-157a64a7-0797-4ad6-bbc0-05dd25668379-detach_volume" by "detach_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:19:10.882754 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-8f1e0402-58bc-4411-8659-cc27a2921c4b tempest-TestVolumeBootPattern-1121030847 None] Create snapshot completed successfully
Oct 29 21:19:10.922243 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-8e08af43-cad5-4e24-af4b-553e28291c67 tempest-VolumesActionsTest-1690945690 None] Lock "cinder-157a64a7-0797-4ad6-bbc0-05dd25668379-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:19:10.923348 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-8e08af43-cad5-4e24-af4b-553e28291c67 tempest-VolumesActionsTest-1690945690 None] Detaching volume 157a64a7-0797-4ad6-bbc0-05dd25668379 from instance fe3541b7-23c4-486b-923c-1c28b40b5c26.
Oct 29 21:19:11.051790 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-8e08af43-cad5-4e24-af4b-553e28291c67 tempest-VolumesActionsTest-1690945690 None] Detach volume completed successfully.
Oct 29 21:19:11.067914 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-8e08af43-cad5-4e24-af4b-553e28291c67 tempest-VolumesActionsTest-1690945690 None] Lock "cinder-157a64a7-0797-4ad6-bbc0-05dd25668379-detach_volume" released by "detach_volume" :: held 0.146s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:19:16.699040 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:19:16.785568 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Flow 'volume_create_manager' (a778d2c2-7fb1-4ae6-a789-7d8427e2ed5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:19:16.808624 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d37ff0a-07a8-4a43-8d4a-188f41426337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:16.851539 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d37ff0a-07a8-4a43-8d4a-188f41426337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:19:16Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ecf01ce3-f780-4b15-ac50-1d2731bf8a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1eca42e66ec4ad1b747ef6027e894df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aa877e52-8cbd-4479-8c45-138a06d0ebd0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:19:17Z,use_quota=True,user_id='1254ce210eae494b8c2bfc925b9978c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:16.869211 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27eff59b-205f-433b-af39-90de1327bc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:16.883885 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27eff59b-205f-433b-af39-90de1327bc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:16.890361 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8815e2bd-e6d2-476c-97c7-84bb483d6f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:16.895470 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8815e2bd-e6d2-476c-97c7-84bb483d6f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ecf01ce3-f780-4b15-ac50-1d2731bf8a59', 'volume_name': 'volume-ecf01ce3-f780-4b15-ac50-1d2731bf8a59', 'volume_size': 1, 'snapshot_id': 'aa877e52-8cbd-4479-8c45-138a06d0ebd0'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:16.912503 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5f4035-fa1b-46a6-89aa-78d814b546a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:16.925531 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5f4035-fa1b-46a6-89aa-78d814b546a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:16.934114 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853734c6-5132-4d71-a4be-24b82fc97ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:16.940803 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Volume ecf01ce3-f780-4b15-ac50-1d2731bf8a59: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ecf01ce3-f780-4b15-ac50-1d2731bf8a59', 'volume_size': 1, 'snapshot_id': 'aa877e52-8cbd-4479-8c45-138a06d0ebd0'}
Oct 29 21:19:16.984873 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] cloning volumes/volume-53975089-e27f-40d6-82a2-af7e36d6fbfd@snapshot-aa877e52-8cbd-4479-8c45-138a06d0ebd0 to volume-ecf01ce3-f780-4b15-ac50-1d2731bf8a59 {{(pid=131780) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}}
Oct 29 21:19:16.986636 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:19:17.106147 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:19:17.323758 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:19:17.324816 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:19:17.352945 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Marking volume ecf01ce3-f780-4b15-ac50-1d2731bf8a59 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 21:19:17.360386 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Copying metadata from snapshot aa877e52-8cbd-4479-8c45-138a06d0ebd0 to ecf01ce3-f780-4b15-ac50-1d2731bf8a59. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}}
Oct 29 21:19:17.413145 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (853734c6-5132-4d71-a4be-24b82fc97ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf01ce3-f780-4b15-ac50-1d2731bf8a59', 'volume_size': 1, 'snapshot_id': 'aa877e52-8cbd-4479-8c45-138a06d0ebd0'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:17.420758 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc7cea9-b2c5-47ce-b967-cda0c8e2bde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:17.434786 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Volume volume-ecf01ce3-f780-4b15-ac50-1d2731bf8a59 (ecf01ce3-f780-4b15-ac50-1d2731bf8a59): created successfully
Oct 29 21:19:17.441408 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc7cea9-b2c5-47ce-b967-cda0c8e2bde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:17.450047 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Flow 'volume_create_manager' (a778d2c2-7fb1-4ae6-a789-7d8427e2ed5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:19:17.484212 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-57d7e12c-371a-4bd9-bf12-64baa1339cec tempest-TestVolumeBootPattern-1121030847 None] Created volume successfully.
Oct 29 21:19:20.355527 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-18cf203a-86df-43f7-acff-4a4f67f80bf8 tempest-TestVolumeBootPattern-1121030847 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:19:22.036919 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-18cf203a-86df-43f7-acff-4a4f67f80bf8 tempest-TestVolumeBootPattern-1121030847 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.685s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:19:22.039156 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-18cf203a-86df-43f7-acff-4a4f67f80bf8 tempest-TestVolumeBootPattern-1121030847 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ecf01ce3-f780-4b15-ac50-1d2731bf8a59', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'ecf01ce3-f780-4b15-ac50-1d2731bf8a59', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:19:22.094217 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-18cf203a-86df-43f7-acff-4a4f67f80bf8 tempest-TestVolumeBootPattern-1121030847 None] Connection info returned from driver {'name': 'volumes/volume-ecf01ce3-f780-4b15-ac50-1d2731bf8a59', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ecf01ce3-f780-4b15-ac50-1d2731bf8a59', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd7820c1e-a545-41e5-a5ea-73435986437d'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:19:22.172776 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-e5f7cc57-7006-4ebb-99cc-2a807df28dd4 req-18cf203a-86df-43f7-acff-4a4f67f80bf8 tempest-TestVolumeBootPattern-1121030847 None] attachment_update completed successfully.
Oct 29 21:19:41.288191 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-103c3c53-ec3b-4b3a-831e-6db4e2a139c0 tempest-VolumesActionsTest-1690945690 None] Acquiring lock "cinder-157a64a7-0797-4ad6-bbc0-05dd25668379" by "attach_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:19:41.306391 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-103c3c53-ec3b-4b3a-831e-6db4e2a139c0 tempest-VolumesActionsTest-1690945690 None] Lock "cinder-157a64a7-0797-4ad6-bbc0-05dd25668379" acquired by "attach_volume" :: waited 0.018s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:19:41.314277 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:INSERT=18,cinder:SELECT=43,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:19:41.316390 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=65,cinder:UPDATE=9,cinder:INSERT=18,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:19:41.383261 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-103c3c53-ec3b-4b3a-831e-6db4e2a139c0 tempest-VolumesActionsTest-1690945690 None] Attaching volume 157a64a7-0797-4ad6-bbc0-05dd25668379 to instance ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b at mountpoint /dev/sdb on host None.
Oct 29 21:19:41.423506 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-103c3c53-ec3b-4b3a-831e-6db4e2a139c0 tempest-VolumesActionsTest-1690945690 None] Attach volume completed successfully.
Oct 29 21:19:41.430842 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-103c3c53-ec3b-4b3a-831e-6db4e2a139c0 tempest-VolumesActionsTest-1690945690 None] Lock "cinder-157a64a7-0797-4ad6-bbc0-05dd25668379" released by "attach_volume" :: held 0.125s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:19:41.861206 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9f39d674-b2f3-4479-b55e-2c474fa0a8b1 tempest-VolumesActionsTest-1690945690 None] Acquiring lock "cinder-157a64a7-0797-4ad6-bbc0-05dd25668379-detach_volume" by "detach_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:19:41.886641 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9f39d674-b2f3-4479-b55e-2c474fa0a8b1 tempest-VolumesActionsTest-1690945690 None] Lock "cinder-157a64a7-0797-4ad6-bbc0-05dd25668379-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:19:41.888951 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-9f39d674-b2f3-4479-b55e-2c474fa0a8b1 tempest-VolumesActionsTest-1690945690 None] Detaching volume 157a64a7-0797-4ad6-bbc0-05dd25668379 from instance ae0bbe86-dc2b-4b0e-aa81-7a2a2fe4518b.
Oct 29 21:19:41.952747 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-9f39d674-b2f3-4479-b55e-2c474fa0a8b1 tempest-VolumesActionsTest-1690945690 None] Detach volume completed successfully.
Oct 29 21:19:41.959966 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-9f39d674-b2f3-4479-b55e-2c474fa0a8b1 tempest-VolumesActionsTest-1690945690 None] Lock "cinder-157a64a7-0797-4ad6-bbc0-05dd25668379-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:19:44.899304 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 req-f84fffbd-d5dd-4f69-8df1-ae68ad2016f3 tempest-TestVolumeBootPattern-1121030847 None] Terminate volume connection completed successfully.
Oct 29 21:19:44.900393 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 req-f84fffbd-d5dd-4f69-8df1-ae68ad2016f3 tempest-TestVolumeBootPattern-1121030847 None] Deleting attachment d7820c1e-a545-41e5-a5ea-73435986437d. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:19:45.090859 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 req-76bbce25-3774-45d9-bb28-8ec2c810ca5e tempest-TestVolumeBootPattern-1121030847 None] Acquiring lock "cinder-ecf01ce3-f780-4b15-ac50-1d2731bf8a59-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:19:45.102822 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 req-76bbce25-3774-45d9-bb28-8ec2c810ca5e tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-ecf01ce3-f780-4b15-ac50-1d2731bf8a59-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:19:45.156880 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 req-76bbce25-3774-45d9-bb28-8ec2c810ca5e tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:19:45.315417 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 req-76bbce25-3774-45d9-bb28-8ec2c810ca5e tempest-TestVolumeBootPattern-1121030847 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:19:45.330588 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 req-76bbce25-3774-45d9-bb28-8ec2c810ca5e tempest-TestVolumeBootPattern-1121030847 None] deleting rbd volume volume-ecf01ce3-f780-4b15-ac50-1d2731bf8a59 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:19:45.653215 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 req-76bbce25-3774-45d9-bb28-8ec2c810ca5e tempest-TestVolumeBootPattern-1121030847 None] Created reservations ['4a771396-7552-4551-8666-3f0c35fe0c75', 'f41abbf4-10b4-4b41-8380-6a824b7458ad', '30f4f3e8-770e-4f96-a9bd-56fa277edb54', 'ec6d148c-9288-4d08-a03f-1855b660d8c0'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:19:45.741010 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 req-76bbce25-3774-45d9-bb28-8ec2c810ca5e tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:19:45.834626 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 req-76bbce25-3774-45d9-bb28-8ec2c810ca5e tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:19:45.902952 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 req-76bbce25-3774-45d9-bb28-8ec2c810ca5e tempest-TestVolumeBootPattern-1121030847 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:19:45.909238 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 req-76bbce25-3774-45d9-bb28-8ec2c810ca5e tempest-TestVolumeBootPattern-1121030847 None] Deleted volume successfully.
Oct 29 21:19:45.930070 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-ff2bd4d3-28d4-47ba-a559-8f1b39b23104 req-76bbce25-3774-45d9-bb28-8ec2c810ca5e tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-ecf01ce3-f780-4b15-ac50-1d2731bf8a59-delete_volume" released by "delete_volume" :: held 0.827s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:19:47.022926 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b9cfdfdd-3cc1-4229-9d42-e41ee21b878d tempest-TestVolumeBootPattern-1121030847 None] Acquiring lock "cinder-aa877e52-8cbd-4479-8c45-138a06d0ebd0-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:19:47.043928 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b9cfdfdd-3cc1-4229-9d42-e41ee21b878d tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-aa877e52-8cbd-4479-8c45-138a06d0ebd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:19:47.051310 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b9cfdfdd-3cc1-4229-9d42-e41ee21b878d tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:19:47.747771 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-b9cfdfdd-3cc1-4229-9d42-e41ee21b878d tempest-TestVolumeBootPattern-1121030847 None] Created reservations ['113eccb5-b9bb-4729-a506-92baf82a56fd', '6012539e-a66b-4f62-ab57-cd703e39cf11', 'a3f2777a-4cef-4f2d-a715-6d549e764e93', '5b5aed35-e60c-49bb-8fb8-405602c3d273'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:19:47.819254 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-1d50983b-d5bb-411a-95fa-ff06583781a6 tempest-VolumesActionsTest-1690945690 None] Running cmd (subprocess): rbd export --pool volumes volume-157a64a7-0797-4ad6-bbc0-05dd25668379 /opt/stack/data/cinder/conversion/volume-157a64a7-0797-4ad6-bbc0-05dd25668379-5f1379bc-56ed-4d0e-baa4-c11b6d05a469 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:19:47.892457 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b9cfdfdd-3cc1-4229-9d42-e41ee21b878d tempest-TestVolumeBootPattern-1121030847 None] Delete snapshot completed successfully.
Oct 29 21:19:47.904329 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b9cfdfdd-3cc1-4229-9d42-e41ee21b878d tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-aa877e52-8cbd-4479-8c45-138a06d0ebd0-delete_snapshot" released by "delete_snapshot" :: held 0.861s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:19:48.254732 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c5a4ee6b-7fb7-4f27-93d3-09ef32c6f866 tempest-TestVolumeBootPattern-1121030847 None] Acquiring lock "cinder-53975089-e27f-40d6-82a2-af7e36d6fbfd-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:19:48.280124 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c5a4ee6b-7fb7-4f27-93d3-09ef32c6f866 tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-53975089-e27f-40d6-82a2-af7e36d6fbfd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:19:48.351600 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c5a4ee6b-7fb7-4f27-93d3-09ef32c6f866 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:19:48.475080 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c5a4ee6b-7fb7-4f27-93d3-09ef32c6f866 tempest-TestVolumeBootPattern-1121030847 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:19:48.488553 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c5a4ee6b-7fb7-4f27-93d3-09ef32c6f866 tempest-TestVolumeBootPattern-1121030847 None] deleting rbd volume volume-53975089-e27f-40d6-82a2-af7e36d6fbfd {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:19:48.845449 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c5a4ee6b-7fb7-4f27-93d3-09ef32c6f866 tempest-TestVolumeBootPattern-1121030847 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 21:19:48.893966 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c5a4ee6b-7fb7-4f27-93d3-09ef32c6f866 tempest-TestVolumeBootPattern-1121030847 None] deleting parent snapshot volume-53975089-e27f-40d6-82a2-af7e36d6fbfd.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 21:19:49.745569 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-1d50983b-d5bb-411a-95fa-ff06583781a6 tempest-VolumesActionsTest-1690945690 None] CMD "rbd export --pool volumes volume-157a64a7-0797-4ad6-bbc0-05dd25668379 /opt/stack/data/cinder/conversion/volume-157a64a7-0797-4ad6-bbc0-05dd25668379-5f1379bc-56ed-4d0e-baa4-c11b6d05a469 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.927s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:19:49.757946 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.image_utils [None req-1d50983b-d5bb-411a-95fa-ff06583781a6 tempest-VolumesActionsTest-1690945690 None] 5f1379bc-56ed-4d0e-baa4-c11b6d05a469 was raw, no need to convert to raw {{(pid=131780) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:851}}
Oct 29 21:19:49.806858 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-c5a4ee6b-7fb7-4f27-93d3-09ef32c6f866 tempest-TestVolumeBootPattern-1121030847 None] Created reservations ['cbcbfd37-bfe4-4349-9176-c0a8a0e6ffa2', '0af2ee39-7b2d-4ac6-9276-673548bd6709', '15a320e6-2f42-4c8a-bc3d-66686eb1e4fa', '0439c077-582d-426c-ba25-0165a63e164c'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:19:49.902618 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c5a4ee6b-7fb7-4f27-93d3-09ef32c6f866 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:19:49.964821 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c5a4ee6b-7fb7-4f27-93d3-09ef32c6f866 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:19:50.026199 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-c5a4ee6b-7fb7-4f27-93d3-09ef32c6f866 tempest-TestVolumeBootPattern-1121030847 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:19:50.035236 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-c5a4ee6b-7fb7-4f27-93d3-09ef32c6f866 tempest-TestVolumeBootPattern-1121030847 None] Deleted volume successfully.
Oct 29 21:19:50.064542 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c5a4ee6b-7fb7-4f27-93d3-09ef32c6f866 tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-53975089-e27f-40d6-82a2-af7e36d6fbfd-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:19:51.581647 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:19:51.605871 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Flow 'volume_create_manager' (e3f242f9-86a6-4301-940c-8917261b55d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:19:51.616452 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb0a475-7c3c-434a-82cb-8d9f3d16b27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:51.637649 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb0a475-7c3c-434a-82cb-8d9f3d16b27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1997736994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d77b83fc-0cf8-47e0-ab3e-e84abfe35d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1eca42e66ec4ad1b747ef6027e894df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:19:52Z,use_quota=True,user_id='1254ce210eae494b8c2bfc925b9978c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:51.646457 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6fae43-b937-4b17-919a-4de8b2dad1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:51.652018 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6fae43-b937-4b17-919a-4de8b2dad1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:51.657434 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38bdee4a-8a38-48fe-a526-97eac3beb081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:51.851194 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38bdee4a-8a38-48fe-a526-97eac3beb081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd77b83fc-0cf8-47e0-ab3e-e84abfe35d95', 'volume_name': 'volume-d77b83fc-0cf8-47e0-ab3e-e84abfe35d95', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f934659fbe0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:51.867542 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398bad7a-e5f5-43c6-8120-4edffe2b1e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:51.884457 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398bad7a-e5f5-43c6-8120-4edffe2b1e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:51.892694 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4f6926-6da9-4008-ab69-170b4b90e045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:51.895721 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Volume d77b83fc-0cf8-47e0-ab3e-e84abfe35d95: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d77b83fc-0cf8-47e0-ab3e-e84abfe35d95', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f934659fbe0>}
Oct 29 21:19:51.897033 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Cloning d77b83fc-0cf8-47e0-ab3e-e84abfe35d95 from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 21:19:51.901518 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:19:52.021008 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.119s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:19:52.036782 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 19, 52, 25915)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:19:52.037226 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:19:52.038171 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Found cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 29 21:19:52.051062 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 0.026s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:19:52.052099 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 21:19:52.076158 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 19, 52, 67847)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:19:52.079441 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:19:52.080072 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Creating from source image-volume fbe0dd2e-351a-4779-844d-3c66baf14939 {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 29 21:19:52.109586 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:19:52.239690 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] creating snapshot='volume-d77b83fc-0cf8-47e0-ab3e-e84abfe35d95.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 21:19:52.779195 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] cloning 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939@volume-d77b83fc-0cf8-47e0-ab3e-e84abfe35d95.clone_snap' to 'volume-d77b83fc-0cf8-47e0-ab3e-e84abfe35d95' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 21:19:53.036332 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:19:53.037219 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:19:53.044278 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:19:53.063145 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 21:19:53.063770 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Marking volume d77b83fc-0cf8-47e0-ab3e-e84abfe35d95 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 21:19:53.083457 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to d77b83fc-0cf8-47e0-ab3e-e84abfe35d95. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 21:19:53.083457 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Creating volume glance metadata for volume d77b83fc-0cf8-47e0-ab3e-e84abfe35d95 backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 21:19:53.115846 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=61,cinder:INSERT=10,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:19:53.149045 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=61,cinder:UPDATE=26,cinder:INSERT=12,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:19:53.187233 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4f6926-6da9-4008-ab69-170b4b90e045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77b83fc-0cf8-47e0-ab3e-e84abfe35d95', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f934659fbe0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:53.199945 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592c4e69-fc11-47d0-81d9-ba2958e36060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:19:53.218207 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Volume volume-d77b83fc-0cf8-47e0-ab3e-e84abfe35d95 (d77b83fc-0cf8-47e0-ab3e-e84abfe35d95): created successfully
Oct 29 21:19:53.222578 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592c4e69-fc11-47d0-81d9-ba2958e36060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:19:53.228563 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Flow 'volume_create_manager' (e3f242f9-86a6-4301-940c-8917261b55d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:19:53.261431 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b3c7229b-12f6-4569-a10b-cc04daf999e6 tempest-TestVolumeBootPattern-1121030847 None] Created volume successfully.
Oct 29 21:19:58.776017 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-a6c477ec-e8ae-4be3-b128-762a790be853 req-79440e15-c707-477e-9867-89ff1a15c431 tempest-TestVolumeBootPattern-1121030847 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:20:00.761517 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-a6c477ec-e8ae-4be3-b128-762a790be853 req-79440e15-c707-477e-9867-89ff1a15c431 tempest-TestVolumeBootPattern-1121030847 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.985s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:20:00.763286 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-a6c477ec-e8ae-4be3-b128-762a790be853 req-79440e15-c707-477e-9867-89ff1a15c431 tempest-TestVolumeBootPattern-1121030847 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d77b83fc-0cf8-47e0-ab3e-e84abfe35d95', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'd77b83fc-0cf8-47e0-ab3e-e84abfe35d95', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:20:00.805268 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-a6c477ec-e8ae-4be3-b128-762a790be853 req-79440e15-c707-477e-9867-89ff1a15c431 tempest-TestVolumeBootPattern-1121030847 None] Connection info returned from driver {'name': 'volumes/volume-d77b83fc-0cf8-47e0-ab3e-e84abfe35d95', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd77b83fc-0cf8-47e0-ab3e-e84abfe35d95', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9d7d6601-68e8-4885-8611-a149d72d9fc0'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:20:00.893130 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-a6c477ec-e8ae-4be3-b128-762a790be853 req-79440e15-c707-477e-9867-89ff1a15c431 tempest-TestVolumeBootPattern-1121030847 None] attachment_update completed successfully.
Oct 29 21:20:01.424196 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:20:01.425972 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:01.530768 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:01.587225 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:20:11.976796 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:20:11.999863 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Flow 'volume_create_manager' (4f2f0246-7680-4d3e-b154-d98feb85e252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:20:12.006447 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d8da9d-e1eb-4f67-95d4-4f1e166bf001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:12.024157 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d8da9d-e1eb-4f67-95d4-4f1e166bf001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1893836648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4aee1bcf-8ea3-4bc2-9a22-a01a3cd3e192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f06a57d37549f09493f5a72d482d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:20:12Z,use_quota=True,user_id='2e004dff565d4a7c9e42574115e15157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:12.029730 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2e353f-ba74-49a4-b0cd-da0b75e75db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:12.038195 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d2e353f-ba74-49a4-b0cd-da0b75e75db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:12.039731 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6b9996-b8f8-4684-9a33-bc62a534d953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:12.043814 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a6b9996-b8f8-4684-9a33-bc62a534d953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aee1bcf-8ea3-4bc2-9a22-a01a3cd3e192', 'volume_name': 'volume-4aee1bcf-8ea3-4bc2-9a22-a01a3cd3e192', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:12.049263 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb5ed40-6593-4bd3-aed2-c671284aecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:12.053143 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb5ed40-6593-4bd3-aed2-c671284aecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:12.058046 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a58bb9-c5ff-4e00-a317-ef6979a47e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:12.059201 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Volume 4aee1bcf-8ea3-4bc2-9a22-a01a3cd3e192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aee1bcf-8ea3-4bc2-9a22-a01a3cd3e192', 'volume_size': 1}
Oct 29 21:20:12.059678 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] creating volume 'volume-4aee1bcf-8ea3-4bc2-9a22-a01a3cd3e192' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:20:12.060645 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:12.144063 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:20:12.144453 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:20:12.148069 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a58bb9-c5ff-4e00-a317-ef6979a47e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aee1bcf-8ea3-4bc2-9a22-a01a3cd3e192', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:12.152520 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07d3396-13a3-45f1-adb3-366400f640dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:12.167808 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Volume volume-4aee1bcf-8ea3-4bc2-9a22-a01a3cd3e192 (4aee1bcf-8ea3-4bc2-9a22-a01a3cd3e192): created successfully
Oct 29 21:20:12.171576 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07d3396-13a3-45f1-adb3-366400f640dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:12.178773 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Flow 'volume_create_manager' (4f2f0246-7680-4d3e-b154-d98feb85e252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:20:12.193764 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4fbdea6a-f5b1-479b-a8a6-7c04e1a248db tempest-SnapshotsActionsTest-673071087 None] Created volume successfully.
Oct 29 21:20:13.228265 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-88ca846a-e88f-4e4e-8cdd-058cad3f2a9a tempest-SnapshotsActionsTest-673071087 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:13.772157 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-6a588d89-5a3a-4cc3-a590-4238e11e834c req-3797e5c8-f9d5-48f1-84d3-ec3ea85bc26f tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:13.947835 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-88ca846a-e88f-4e4e-8cdd-058cad3f2a9a tempest-SnapshotsActionsTest-673071087 None] Create snapshot completed successfully
Oct 29 21:20:14.956733 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-6a588d89-5a3a-4cc3-a590-4238e11e834c req-3797e5c8-f9d5-48f1-84d3-ec3ea85bc26f tempest-TestVolumeBootPattern-1121030847 None] Create snapshot completed successfully
Oct 29 21:20:15.289865 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4fa08a98-d0e9-4df7-ab06-b6bd2fc1a0ef tempest-SnapshotsActionsTest-673071087 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:15.877207 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4fa08a98-d0e9-4df7-ab06-b6bd2fc1a0ef tempest-SnapshotsActionsTest-673071087 None] Create snapshot completed successfully
Oct 29 21:20:16.536711 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e1805e02-99b7-42e0-a197-09845c0bc7f6 tempest-SnapshotsActionsTest-699017526 None] Acquiring lock "cinder-f1d4cbb5-e44d-41a3-bf99-4e4720f130da-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:20:16.549592 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e1805e02-99b7-42e0-a197-09845c0bc7f6 tempest-SnapshotsActionsTest-699017526 None] Lock "cinder-f1d4cbb5-e44d-41a3-bf99-4e4720f130da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:20:16.551723 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e1805e02-99b7-42e0-a197-09845c0bc7f6 tempest-SnapshotsActionsTest-699017526 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:17.762428 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-e1805e02-99b7-42e0-a197-09845c0bc7f6 tempest-SnapshotsActionsTest-699017526 None] Created reservations ['ea49307e-8162-46f6-a497-52f2bf6e7a6e', 'e751d14d-10b3-47e5-8e70-43c40d797d76', '3b87ad37-6d45-471f-8ddd-2c95135f82f1', '381adf5f-aaec-4f4d-892a-5a3d47db5239'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:20:17.821831 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-e1805e02-99b7-42e0-a197-09845c0bc7f6 tempest-SnapshotsActionsTest-699017526 None] Delete snapshot completed successfully.
Oct 29 21:20:17.830217 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-e1805e02-99b7-42e0-a197-09845c0bc7f6 tempest-SnapshotsActionsTest-699017526 None] Lock "cinder-f1d4cbb5-e44d-41a3-bf99-4e4720f130da-delete_snapshot" released by "delete_snapshot" :: held 1.281s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:20:19.183962 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:20:19.283516 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Flow 'volume_create_manager' (e8a5a46a-5897-4ced-9a53-29cd0a1b57fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:20:19.302842 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9225bab0-d047-4d3e-952d-5c8df65bf125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:19.339319 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9225bab0-d047-4d3e-952d-5c8df65bf125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:20:19Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ced8ec83-8198-4043-a6ba-4277b9cbb8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1eca42e66ec4ad1b747ef6027e894df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f73a835b-6da5-4752-928d-e711f4fbd229,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:20:19Z,use_quota=True,user_id='1254ce210eae494b8c2bfc925b9978c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:19.347321 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065b51ad-231c-44f6-9978-28d0b5829bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:19.353120 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (065b51ad-231c-44f6-9978-28d0b5829bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:19.361172 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b42f298-06d3-4566-9303-ccdc0218803c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:19.366667 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b42f298-06d3-4566-9303-ccdc0218803c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ced8ec83-8198-4043-a6ba-4277b9cbb8e7', 'volume_name': 'volume-ced8ec83-8198-4043-a6ba-4277b9cbb8e7', 'volume_size': 1, 'snapshot_id': 'f73a835b-6da5-4752-928d-e711f4fbd229'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:19.372249 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a121575d-e04d-4171-b9b8-2255b05a9433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:19.378107 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a121575d-e04d-4171-b9b8-2255b05a9433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:19.384334 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1364e6f1-40f9-4bfc-99db-ae768a42c8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:19.385194 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Volume ced8ec83-8198-4043-a6ba-4277b9cbb8e7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ced8ec83-8198-4043-a6ba-4277b9cbb8e7', 'volume_size': 1, 'snapshot_id': 'f73a835b-6da5-4752-928d-e711f4fbd229'}
Oct 29 21:20:19.458767 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-736c56ff-3656-4974-99e6-500398178306 tempest-SnapshotsActionsTest-673071087 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:19.544133 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] cloning volumes/volume-d77b83fc-0cf8-47e0-ab3e-e84abfe35d95@snapshot-f73a835b-6da5-4752-928d-e711f4fbd229 to volume-ced8ec83-8198-4043-a6ba-4277b9cbb8e7 {{(pid=131780) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}}
Oct 29 21:20:19.546322 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:19.668107 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:19.937830 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-1d50983b-d5bb-411a-95fa-ff06583781a6 tempest-VolumesActionsTest-1690945690 None] Uploaded volume to glance image-id: 5f1379bc-56ed-4d0e-baa4-c11b6d05a469. {{(pid=131780) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1791}}
Oct 29 21:20:19.964180 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:20:19.964563 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:20:19.973994 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-1d50983b-d5bb-411a-95fa-ff06583781a6 tempest-VolumesActionsTest-1690945690 None] Copy volume to image completed successfully.
Oct 29 21:20:19.987957 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-736c56ff-3656-4974-99e6-500398178306 tempest-SnapshotsActionsTest-673071087 None] Create snapshot completed successfully
Oct 29 21:20:20.011626 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Marking volume ced8ec83-8198-4043-a6ba-4277b9cbb8e7 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 21:20:20.040269 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Copying metadata from snapshot f73a835b-6da5-4752-928d-e711f4fbd229 to ced8ec83-8198-4043-a6ba-4277b9cbb8e7. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}}
Oct 29 21:20:20.063020 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=66,cinder:DELETE=3,cinder:UPDATE=14,cinder:INSERT=17 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:20:20.083239 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1364e6f1-40f9-4bfc-99db-ae768a42c8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced8ec83-8198-4043-a6ba-4277b9cbb8e7', 'volume_size': 1, 'snapshot_id': 'f73a835b-6da5-4752-928d-e711f4fbd229'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:20.088319 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8eea46e-80dc-48ad-9055-7082049a28b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:20.098715 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Volume volume-ced8ec83-8198-4043-a6ba-4277b9cbb8e7 (ced8ec83-8198-4043-a6ba-4277b9cbb8e7): created successfully
Oct 29 21:20:20.103410 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8eea46e-80dc-48ad-9055-7082049a28b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:20.108060 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Flow 'volume_create_manager' (e8a5a46a-5897-4ced-9a53-29cd0a1b57fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:20:20.118138 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:INSERT=15,cinder:SELECT=62,cinder:UPDATE=20,cinder:DELETE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:20:20.123293 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-36b06bc2-f02a-4c81-b255-6976b8a9e75d tempest-TestVolumeBootPattern-1121030847 None] Created volume successfully.
Oct 29 21:20:20.565143 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-3da8ea9a-b2b2-4b2e-a5a4-64cf5e82ca7a tempest-SnapshotsActionsTest-699017526 None] Acquiring lock "cinder-1f1e78ff-2af0-4d94-8469-1384912dd8f8-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:20:20.575394 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-3da8ea9a-b2b2-4b2e-a5a4-64cf5e82ca7a tempest-SnapshotsActionsTest-699017526 None] Lock "cinder-1f1e78ff-2af0-4d94-8469-1384912dd8f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:20:20.576842 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3da8ea9a-b2b2-4b2e-a5a4-64cf5e82ca7a tempest-SnapshotsActionsTest-699017526 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:21.222702 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-042bc698-dd4e-453e-b000-3e0ba4214e3a tempest-VolumesActionsTest-1690945690 None] Acquiring lock "cinder-157a64a7-0797-4ad6-bbc0-05dd25668379-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:20:21.232718 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-042bc698-dd4e-453e-b000-3e0ba4214e3a tempest-VolumesActionsTest-1690945690 None] Lock "cinder-157a64a7-0797-4ad6-bbc0-05dd25668379-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:20:21.280850 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-042bc698-dd4e-453e-b000-3e0ba4214e3a tempest-VolumesActionsTest-1690945690 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:21.346774 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-042bc698-dd4e-453e-b000-3e0ba4214e3a tempest-VolumesActionsTest-1690945690 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:20:21.347238 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-042bc698-dd4e-453e-b000-3e0ba4214e3a tempest-VolumesActionsTest-1690945690 None] Volume volume-157a64a7-0797-4ad6-bbc0-05dd25668379 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:20:21.353188 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-042bc698-dd4e-453e-b000-3e0ba4214e3a tempest-VolumesActionsTest-1690945690 None] deleting rbd volume volume-157a64a7-0797-4ad6-bbc0-05dd25668379 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:20:21.577190 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-042bc698-dd4e-453e-b000-3e0ba4214e3a tempest-VolumesActionsTest-1690945690 None] Created reservations ['df8b6687-f6b8-4e0e-a580-cea53df24ad6', '3fa96adf-b5e1-4b58-9cc2-271a6646bab0', 'b9eef816-f44e-4b0a-8b96-0c36f80db379', 'e604c811-2e5a-47c3-8d10-f9c1562b45dc'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:20:21.635021 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-042bc698-dd4e-453e-b000-3e0ba4214e3a tempest-VolumesActionsTest-1690945690 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:21.680723 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-042bc698-dd4e-453e-b000-3e0ba4214e3a tempest-VolumesActionsTest-1690945690 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:21.718352 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-042bc698-dd4e-453e-b000-3e0ba4214e3a tempest-VolumesActionsTest-1690945690 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:20:21.723875 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-042bc698-dd4e-453e-b000-3e0ba4214e3a tempest-VolumesActionsTest-1690945690 None] Deleted volume successfully.
Oct 29 21:20:21.750600 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-042bc698-dd4e-453e-b000-3e0ba4214e3a tempest-VolumesActionsTest-1690945690 None] Lock "cinder-157a64a7-0797-4ad6-bbc0-05dd25668379-delete_volume" released by "delete_volume" :: held 0.517s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:20:21.798090 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-3da8ea9a-b2b2-4b2e-a5a4-64cf5e82ca7a tempest-SnapshotsActionsTest-699017526 None] Created reservations ['0d9a2ca8-5933-4d1c-9514-6ff423517479', '9d085d50-28b7-4592-b4e4-aab9f729e970', 'c844148c-5661-4f90-8322-71a04e0f0fd0', '3430110e-556b-4ea4-ab73-395e0b5dca58'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:20:21.840734 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-3da8ea9a-b2b2-4b2e-a5a4-64cf5e82ca7a tempest-SnapshotsActionsTest-699017526 None] Delete snapshot completed successfully.
Oct 29 21:20:21.846527 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-3da8ea9a-b2b2-4b2e-a5a4-64cf5e82ca7a tempest-SnapshotsActionsTest-699017526 None] Lock "cinder-1f1e78ff-2af0-4d94-8469-1384912dd8f8-delete_snapshot" released by "delete_snapshot" :: held 1.271s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:20:22.620945 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-c7d71b9f-986b-4fc7-a774-24177ef7ecf0 tempest-TestVolumeBootPattern-1121030847 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:20:23.192301 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c2296416-8a53-4567-8a06-71edf11b2f7f tempest-SnapshotsActionsTest-673071087 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:23.823559 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-c7d71b9f-986b-4fc7-a774-24177ef7ecf0 tempest-TestVolumeBootPattern-1121030847 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.198s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:20:23.826821 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-c7d71b9f-986b-4fc7-a774-24177ef7ecf0 tempest-TestVolumeBootPattern-1121030847 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ced8ec83-8198-4043-a6ba-4277b9cbb8e7', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'ced8ec83-8198-4043-a6ba-4277b9cbb8e7', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:20:23.857873 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-c2296416-8a53-4567-8a06-71edf11b2f7f tempest-SnapshotsActionsTest-673071087 None] Create snapshot completed successfully
Oct 29 21:20:23.868013 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-c7d71b9f-986b-4fc7-a774-24177ef7ecf0 tempest-TestVolumeBootPattern-1121030847 None] Connection info returned from driver {'name': 'volumes/volume-ced8ec83-8198-4043-a6ba-4277b9cbb8e7', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ced8ec83-8198-4043-a6ba-4277b9cbb8e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8f0c4e3b-17df-4678-bc7e-f75d5b4912e2'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:20:23.932587 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-4ab5675c-52da-4ef8-9927-324f9672efd3 req-c7d71b9f-986b-4fc7-a774-24177ef7ecf0 tempest-TestVolumeBootPattern-1121030847 None] attachment_update completed successfully.
Oct 29 21:20:24.363290 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a01433ac-5731-4b6c-ae73-4994ae5263ab tempest-SnapshotsActionsTest-699017526 None] Acquiring lock "cinder-e29d837a-4384-4584-9332-e6cc9a559208-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:20:24.377996 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a01433ac-5731-4b6c-ae73-4994ae5263ab tempest-SnapshotsActionsTest-699017526 None] Lock "cinder-e29d837a-4384-4584-9332-e6cc9a559208-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:20:24.380645 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a01433ac-5731-4b6c-ae73-4994ae5263ab tempest-SnapshotsActionsTest-699017526 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:24.826251 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-a01433ac-5731-4b6c-ae73-4994ae5263ab tempest-SnapshotsActionsTest-699017526 None] Created reservations ['9a1b7e2a-f3c5-4c18-afbf-323bfcdbf7a7', '92778601-c324-43cc-b144-110d697d6bca', '1463041d-1206-43c8-9107-052e2883f5ea', 'b0f6b678-fee1-4d57-8d14-ddbe41b6a25f'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:20:24.874024 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a01433ac-5731-4b6c-ae73-4994ae5263ab tempest-SnapshotsActionsTest-699017526 None] Delete snapshot completed successfully.
Oct 29 21:20:24.881966 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a01433ac-5731-4b6c-ae73-4994ae5263ab tempest-SnapshotsActionsTest-699017526 None] Lock "cinder-e29d837a-4384-4584-9332-e6cc9a559208-delete_snapshot" released by "delete_snapshot" :: held 0.504s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:20:25.795424 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-21457aa5-a237-43db-aa6f-751762d73557 tempest-SnapshotsActionsTest-673071087 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:26.682104 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-21457aa5-a237-43db-aa6f-751762d73557 tempest-SnapshotsActionsTest-673071087 None] Create snapshot completed successfully
Oct 29 21:20:26.978618 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-5d7a7927-2dc6-4e14-a153-882426e388c4 tempest-SnapshotsActionsTest-699017526 None] Acquiring lock "cinder-947aede1-c598-4a0d-8711-a01c394b2869-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:20:27.000253 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-5d7a7927-2dc6-4e14-a153-882426e388c4 tempest-SnapshotsActionsTest-699017526 None] Lock "cinder-947aede1-c598-4a0d-8711-a01c394b2869-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:20:27.001732 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5d7a7927-2dc6-4e14-a153-882426e388c4 tempest-SnapshotsActionsTest-699017526 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:27.744896 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:20:27.770338 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Flow 'volume_create_manager' (7f4413c3-4a1b-4aea-86ed-d6d190f0b093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:20:27.780443 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989fa1c3-4811-49c1-ac6c-3f4f7a7f121c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:27.806597 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989fa1c3-4811-49c1-ac6c-3f4f7a7f121c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1318886762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=af1d2ceb-582a-4420-890f-62905eafe75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd289d8c1714b10abcc92910af0e955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:20:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:20:28Z,use_quota=True,user_id='b431fb568f154b84b2970f0b5052e747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:27.813379 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262c7be0-cc46-495a-abd2-5bccc4aba8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:27.819435 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262c7be0-cc46-495a-abd2-5bccc4aba8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:27.825306 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03e3108-9208-42c2-bc40-7f723aee6bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:27.830112 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03e3108-9208-42c2-bc40-7f723aee6bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af1d2ceb-582a-4420-890f-62905eafe75a', 'volume_name': 'volume-af1d2ceb-582a-4420-890f-62905eafe75a', 'volume_size': 2}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:27.834879 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c3e1af-4a57-4b43-b283-f9e579fe971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:27.838686 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c3e1af-4a57-4b43-b283-f9e579fe971a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:27.843160 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fef253e-d275-4b72-9beb-43f2d4726618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:27.844340 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Volume af1d2ceb-582a-4420-890f-62905eafe75a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af1d2ceb-582a-4420-890f-62905eafe75a', 'volume_size': 2}
Oct 29 21:20:27.844750 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] creating volume 'volume-af1d2ceb-582a-4420-890f-62905eafe75a' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:20:27.845551 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:27.928390 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:20:27.928779 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:20:27.932892 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fef253e-d275-4b72-9beb-43f2d4726618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af1d2ceb-582a-4420-890f-62905eafe75a', 'volume_size': 2}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:27.938007 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb839f8c-7b96-4d39-a676-ad74a2e18bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:27.952121 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=64,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=7 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:20:27.962368 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Volume volume-af1d2ceb-582a-4420-890f-62905eafe75a (af1d2ceb-582a-4420-890f-62905eafe75a): created successfully
Oct 29 21:20:27.966178 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb839f8c-7b96-4d39-a676-ad74a2e18bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:27.971893 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Flow 'volume_create_manager' (7f4413c3-4a1b-4aea-86ed-d6d190f0b093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:20:27.977161 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-5d7a7927-2dc6-4e14-a153-882426e388c4 tempest-SnapshotsActionsTest-699017526 None] Created reservations ['eb3a8f4f-7654-4d8a-ba9b-413214194467', 'dd28cc50-c32f-4b2e-86f1-28d05d9270fa', '2a91c742-5cf0-42c5-bc77-94fd2113e0d8', '0081184d-8674-4779-b0fe-8aaccea3c75f'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:20:27.983420 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-accf31ca-819a-4128-963f-201376ab965b tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Created volume successfully.
Oct 29 21:20:27.990883 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=63,cinder:INSERT=9,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:20:28.025973 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-5d7a7927-2dc6-4e14-a153-882426e388c4 tempest-SnapshotsActionsTest-699017526 None] Delete snapshot completed successfully.
Oct 29 21:20:28.028569 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-5d7a7927-2dc6-4e14-a153-882426e388c4 tempest-SnapshotsActionsTest-699017526 None] Lock "cinder-947aede1-c598-4a0d-8711-a01c394b2869-delete_snapshot" released by "delete_snapshot" :: held 1.028s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:20:28.489228 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-34f1596f-462f-44e0-bd50-dbb3a6a32045 tempest-SnapshotsActionsTest-673071087 None] Acquiring lock "cinder-5efa29f4-e7ba-4f51-b5c4-cbab83b3e938-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:20:28.500009 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-34f1596f-462f-44e0-bd50-dbb3a6a32045 tempest-SnapshotsActionsTest-673071087 None] Lock "cinder-5efa29f4-e7ba-4f51-b5c4-cbab83b3e938-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:20:28.503102 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-34f1596f-462f-44e0-bd50-dbb3a6a32045 tempest-SnapshotsActionsTest-673071087 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:28.907717 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-34f1596f-462f-44e0-bd50-dbb3a6a32045 tempest-SnapshotsActionsTest-673071087 None] Created reservations ['8448e385-6034-4d38-a550-08ce7ecac8ce', '749e9d23-0a03-40ca-aa5f-33e38a2d4fb4', 'b54553d4-95fe-4858-9978-186d7d1e0121', 'deb511de-76e1-4e6c-a9b0-ccee69ceae65'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:20:28.958956 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-34f1596f-462f-44e0-bd50-dbb3a6a32045 tempest-SnapshotsActionsTest-673071087 None] Delete snapshot completed successfully.
Oct 29 21:20:28.969292 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-34f1596f-462f-44e0-bd50-dbb3a6a32045 tempest-SnapshotsActionsTest-673071087 None] Lock "cinder-5efa29f4-e7ba-4f51-b5c4-cbab83b3e938-delete_snapshot" released by "delete_snapshot" :: held 0.469s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:20:29.021882 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fa2459eb-7f05-4172-9fad-47b3f2f86710 tempest-VolumesSnapshotNegativeTestJSON-136381540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:29.598204 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b3beea11-f834-4173-ac9f-4190690f801d tempest-SnapshotsActionsTest-673071087 None] Acquiring lock "cinder-4aee1bcf-8ea3-4bc2-9a22-a01a3cd3e192-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:20:29.610306 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b3beea11-f834-4173-ac9f-4190690f801d tempest-SnapshotsActionsTest-673071087 None] Lock "cinder-4aee1bcf-8ea3-4bc2-9a22-a01a3cd3e192-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:20:29.652183 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b3beea11-f834-4173-ac9f-4190690f801d tempest-SnapshotsActionsTest-673071087 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:29.712067 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b3beea11-f834-4173-ac9f-4190690f801d tempest-SnapshotsActionsTest-673071087 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:20:29.712793 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b3beea11-f834-4173-ac9f-4190690f801d tempest-SnapshotsActionsTest-673071087 None] Volume volume-4aee1bcf-8ea3-4bc2-9a22-a01a3cd3e192 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:20:29.717309 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b3beea11-f834-4173-ac9f-4190690f801d tempest-SnapshotsActionsTest-673071087 None] deleting rbd volume volume-4aee1bcf-8ea3-4bc2-9a22-a01a3cd3e192 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:20:29.882811 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-fa2459eb-7f05-4172-9fad-47b3f2f86710 tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Create snapshot completed successfully
Oct 29 21:20:29.934632 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-b3beea11-f834-4173-ac9f-4190690f801d tempest-SnapshotsActionsTest-673071087 None] Created reservations ['e5701708-6229-4cc7-b7c5-f48b4e12029a', 'c0d9bc3d-bf14-45b4-9fae-b52f4aa98e0c', '7db23918-3347-413b-98d6-255314dfd57d', 'd39338c0-8499-4498-b7de-c73c211be3bb'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:20:29.978347 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b3beea11-f834-4173-ac9f-4190690f801d tempest-SnapshotsActionsTest-673071087 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:30.024001 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b3beea11-f834-4173-ac9f-4190690f801d tempest-SnapshotsActionsTest-673071087 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:30.067342 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-b3beea11-f834-4173-ac9f-4190690f801d tempest-SnapshotsActionsTest-673071087 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:20:30.071886 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b3beea11-f834-4173-ac9f-4190690f801d tempest-SnapshotsActionsTest-673071087 None] Deleted volume successfully.
Oct 29 21:20:30.089671 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b3beea11-f834-4173-ac9f-4190690f801d tempest-SnapshotsActionsTest-673071087 None] Lock "cinder-4aee1bcf-8ea3-4bc2-9a22-a01a3cd3e192-delete_volume" released by "delete_volume" :: held 0.479s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:20:30.159678 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a6fdd2aa-d4c8-4603-87f2-4d00b3eb0b4c tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Acquiring lock "cinder-038c1712-94f5-4846-8fc6-39e6d300337e-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:20:30.171517 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a6fdd2aa-d4c8-4603-87f2-4d00b3eb0b4c tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Lock "cinder-038c1712-94f5-4846-8fc6-39e6d300337e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:20:30.174514 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a6fdd2aa-d4c8-4603-87f2-4d00b3eb0b4c tempest-VolumesSnapshotNegativeTestJSON-136381540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:30.944266 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-a6fdd2aa-d4c8-4603-87f2-4d00b3eb0b4c tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Created reservations ['3d6ff986-2279-4d9f-8b80-d62678ab1154', '726faa9b-5e2b-46fc-a11c-9c95057492a8', '87388a8f-2f57-4bd5-a933-c31d28132b65', 'c6d658da-07c8-4f3e-8b27-9a319a79160e'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:20:31.008462 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a6fdd2aa-d4c8-4603-87f2-4d00b3eb0b4c tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Delete snapshot completed successfully.
Oct 29 21:20:31.028558 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a6fdd2aa-d4c8-4603-87f2-4d00b3eb0b4c tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Lock "cinder-038c1712-94f5-4846-8fc6-39e6d300337e-delete_snapshot" released by "delete_snapshot" :: held 0.857s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:20:31.327448 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-6b1c8dc3-a204-4908-98ef-6ba1780f5aaa tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Acquiring lock "cinder-af1d2ceb-582a-4420-890f-62905eafe75a-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:20:31.342212 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-6b1c8dc3-a204-4908-98ef-6ba1780f5aaa tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Lock "cinder-af1d2ceb-582a-4420-890f-62905eafe75a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:20:31.415078 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6b1c8dc3-a204-4908-98ef-6ba1780f5aaa tempest-VolumesSnapshotNegativeTestJSON-136381540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:31.476107 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6b1c8dc3-a204-4908-98ef-6ba1780f5aaa tempest-VolumesSnapshotNegativeTestJSON-136381540 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:20:31.476534 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6b1c8dc3-a204-4908-98ef-6ba1780f5aaa tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Volume volume-af1d2ceb-582a-4420-890f-62905eafe75a is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:20:31.486053 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6b1c8dc3-a204-4908-98ef-6ba1780f5aaa tempest-VolumesSnapshotNegativeTestJSON-136381540 None] deleting rbd volume volume-af1d2ceb-582a-4420-890f-62905eafe75a {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:20:31.943636 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-6b1c8dc3-a204-4908-98ef-6ba1780f5aaa tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Created reservations ['137cd390-ffab-4272-bc4a-a6989fae3d3d', '5fa2c764-5cf4-4e0d-bea9-af3bdd4e475b', 'ea207d8d-3666-47e1-b94e-732b2589d280', '2b8acebf-9c44-4e3a-82bc-8c57567d2b42'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:20:31.998985 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6b1c8dc3-a204-4908-98ef-6ba1780f5aaa tempest-VolumesSnapshotNegativeTestJSON-136381540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:32.059142 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-6b1c8dc3-a204-4908-98ef-6ba1780f5aaa tempest-VolumesSnapshotNegativeTestJSON-136381540 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:32.119201 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-6b1c8dc3-a204-4908-98ef-6ba1780f5aaa tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:20:32.123346 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-6b1c8dc3-a204-4908-98ef-6ba1780f5aaa tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Deleted volume successfully.
Oct 29 21:20:32.146914 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-6b1c8dc3-a204-4908-98ef-6ba1780f5aaa tempest-VolumesSnapshotNegativeTestJSON-136381540 None] Lock "cinder-af1d2ceb-582a-4420-890f-62905eafe75a-delete_volume" released by "delete_volume" :: held 0.803s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:20:38.322486 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-1c989c7f-2027-4d24-8d44-f969824f8791 req-34948e5f-0870-4ca1-80cb-640c606c1b25 tempest-TestVolumeBootPattern-1121030847 None] Terminate volume connection completed successfully.
Oct 29 21:20:38.324318 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-1c989c7f-2027-4d24-8d44-f969824f8791 req-34948e5f-0870-4ca1-80cb-640c606c1b25 tempest-TestVolumeBootPattern-1121030847 None] Deleting attachment 8f0c4e3b-17df-4678-bc7e-f75d5b4912e2. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:20:38.602106 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-1c989c7f-2027-4d24-8d44-f969824f8791 req-019ca24c-fc01-494f-a76f-1f57c04c8310 tempest-TestVolumeBootPattern-1121030847 None] Acquiring lock "cinder-ced8ec83-8198-4043-a6ba-4277b9cbb8e7-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:20:38.618809 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-1c989c7f-2027-4d24-8d44-f969824f8791 req-019ca24c-fc01-494f-a76f-1f57c04c8310 tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-ced8ec83-8198-4043-a6ba-4277b9cbb8e7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:20:38.635540 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=41,cinder:SELECT=48,cinder:INSERT=9,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:20:38.678700 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-1c989c7f-2027-4d24-8d44-f969824f8791 req-019ca24c-fc01-494f-a76f-1f57c04c8310 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:38.862009 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-1c989c7f-2027-4d24-8d44-f969824f8791 req-019ca24c-fc01-494f-a76f-1f57c04c8310 tempest-TestVolumeBootPattern-1121030847 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:20:38.877769 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-1c989c7f-2027-4d24-8d44-f969824f8791 req-019ca24c-fc01-494f-a76f-1f57c04c8310 tempest-TestVolumeBootPattern-1121030847 None] deleting rbd volume volume-ced8ec83-8198-4043-a6ba-4277b9cbb8e7 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:20:39.250975 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=26,cinder:SELECT=66,cinder:INSERT=7,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:20:39.290552 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [req-1c989c7f-2027-4d24-8d44-f969824f8791 req-019ca24c-fc01-494f-a76f-1f57c04c8310 tempest-TestVolumeBootPattern-1121030847 None] Created reservations ['77d542cf-c77b-4763-9071-3200cd8d8564', '340ee0c4-9443-457a-adb6-440c9e7c0a36', '0d00df3e-046a-4517-8d4d-da1e10f6751c', '59724278-93e2-4ba1-b08d-44fa7edafee7'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:20:39.394409 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-1c989c7f-2027-4d24-8d44-f969824f8791 req-019ca24c-fc01-494f-a76f-1f57c04c8310 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:39.460393 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-1c989c7f-2027-4d24-8d44-f969824f8791 req-019ca24c-fc01-494f-a76f-1f57c04c8310 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:39.512583 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [req-1c989c7f-2027-4d24-8d44-f969824f8791 req-019ca24c-fc01-494f-a76f-1f57c04c8310 tempest-TestVolumeBootPattern-1121030847 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:20:39.517761 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-1c989c7f-2027-4d24-8d44-f969824f8791 req-019ca24c-fc01-494f-a76f-1f57c04c8310 tempest-TestVolumeBootPattern-1121030847 None] Deleted volume successfully.
Oct 29 21:20:39.537429 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-1c989c7f-2027-4d24-8d44-f969824f8791 req-019ca24c-fc01-494f-a76f-1f57c04c8310 tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-ced8ec83-8198-4043-a6ba-4277b9cbb8e7-delete_volume" released by "delete_volume" :: held 0.919s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:20:40.311306 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:20:40.337997 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Flow 'volume_create_manager' (0c8a54d9-2e3b-4293-97d8-c8af1910d541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:20:40.347433 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93027e40-2fdf-4e9b-b42a-d4062c171613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:40.370148 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93027e40-2fdf-4e9b-b42a-d4062c171613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1813129626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0bf37eb3-87a1-484c-aea4-4d6d92239fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53286b26a98a4b0fafc0f60a3711e751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:20:40Z,use_quota=True,user_id='f917e85770324bd2a633cdfc5a680a47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:40.377872 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939965f8-a1e6-4cf2-bc23-6d241bfa365c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:40.382525 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939965f8-a1e6-4cf2-bc23-6d241bfa365c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:40.390435 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14aee99c-af84-4288-9e05-9c04c047d928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:40.396217 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14aee99c-af84-4288-9e05-9c04c047d928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf37eb3-87a1-484c-aea4-4d6d92239fae', 'volume_name': 'volume-0bf37eb3-87a1-484c-aea4-4d6d92239fae', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:40.402057 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2538b7e3-6230-4b8d-9990-9ae12d8ca06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:40.406698 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2538b7e3-6230-4b8d-9990-9ae12d8ca06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:40.412738 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c78c20-8fe6-4ec2-acd8-de9c3ad6833a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:40.414848 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Volume 0bf37eb3-87a1-484c-aea4-4d6d92239fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf37eb3-87a1-484c-aea4-4d6d92239fae', 'volume_size': 1}
Oct 29 21:20:40.415664 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] creating volume 'volume-0bf37eb3-87a1-484c-aea4-4d6d92239fae' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:20:40.416930 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:40.488169 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:20:40.488545 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:20:40.492119 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c78c20-8fe6-4ec2-acd8-de9c3ad6833a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf37eb3-87a1-484c-aea4-4d6d92239fae', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:40.497712 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9526eb78-0d1c-4071-9b42-156f527945b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:40.508221 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Volume volume-0bf37eb3-87a1-484c-aea4-4d6d92239fae (0bf37eb3-87a1-484c-aea4-4d6d92239fae): created successfully
Oct 29 21:20:40.512267 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9526eb78-0d1c-4071-9b42-156f527945b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:40.519090 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Flow 'volume_create_manager' (0c8a54d9-2e3b-4293-97d8-c8af1910d541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:20:40.530581 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-c537309a-94c7-4718-84cd-321f486faffc tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Created volume successfully.
Oct 29 21:20:40.761617 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-32b55b08-28b8-4fe4-b2f5-ea362125d52f tempest-TestVolumeBootPattern-1121030847 None] Acquiring lock "cinder-f73a835b-6da5-4752-928d-e711f4fbd229-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:20:40.777704 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-32b55b08-28b8-4fe4-b2f5-ea362125d52f tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-f73a835b-6da5-4752-928d-e711f4fbd229-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:20:40.779899 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-32b55b08-28b8-4fe4-b2f5-ea362125d52f tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:41.550665 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-65e84984-ded7-4989-9827-591eb528fb89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:42.742136 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-65e84984-ded7-4989-9827-591eb528fb89 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Create snapshot completed successfully
Oct 29 21:20:44.333790 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-2da5f16f-6424-4f8b-a84f-f7a3f395a7f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Acquiring lock "cinder-29c7f9ae-b1ed-4db5-a89d-f61334f459ab-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:20:44.361625 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-2da5f16f-6424-4f8b-a84f-f7a3f395a7f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Lock "cinder-29c7f9ae-b1ed-4db5-a89d-f61334f459ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:20:44.365446 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-2da5f16f-6424-4f8b-a84f-f7a3f395a7f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:44.790844 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-2da5f16f-6424-4f8b-a84f-f7a3f395a7f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Created reservations ['8a5e2e51-0b12-42e4-ae50-33045992c4a5', '22edb2f9-b6a1-48c7-b80b-295f546335fb', 'abd36f79-b8f6-4559-918e-c2ee800fb03e', '1db72fbd-fd69-4e86-b86c-ed7293f6f222'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:20:44.880531 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-2da5f16f-6424-4f8b-a84f-f7a3f395a7f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Delete snapshot completed successfully.
Oct 29 21:20:44.887309 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-2da5f16f-6424-4f8b-a84f-f7a3f395a7f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Lock "cinder-29c7f9ae-b1ed-4db5-a89d-f61334f459ab-delete_snapshot" released by "delete_snapshot" :: held 0.526s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:20:45.539801 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-0211ca33-cd83-401b-a412-e0c3e4204374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Acquiring lock "cinder-0bf37eb3-87a1-484c-aea4-4d6d92239fae-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:20:45.562910 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-0211ca33-cd83-401b-a412-e0c3e4204374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Lock "cinder-0bf37eb3-87a1-484c-aea4-4d6d92239fae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:20:45.606808 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0211ca33-cd83-401b-a412-e0c3e4204374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:45.690357 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0211ca33-cd83-401b-a412-e0c3e4204374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:20:45.691044 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0211ca33-cd83-401b-a412-e0c3e4204374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Volume volume-0bf37eb3-87a1-484c-aea4-4d6d92239fae is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:20:45.697650 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0211ca33-cd83-401b-a412-e0c3e4204374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] deleting rbd volume volume-0bf37eb3-87a1-484c-aea4-4d6d92239fae {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:20:46.000059 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-0211ca33-cd83-401b-a412-e0c3e4204374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Created reservations ['aabde98b-8c3d-4153-894d-f311afac3160', '4b80ae47-ff05-49dd-9852-9531b0bf8c3a', 'c038bdd6-0562-42df-b127-cc5e36fad66a', '96001c7a-7094-447a-8471-74cd68d93223'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:20:46.064310 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0211ca33-cd83-401b-a412-e0c3e4204374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:46.126125 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-0211ca33-cd83-401b-a412-e0c3e4204374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:46.180700 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-0211ca33-cd83-401b-a412-e0c3e4204374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:20:46.203074 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-0211ca33-cd83-401b-a412-e0c3e4204374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Deleted volume successfully.
Oct 29 21:20:46.231801 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-0211ca33-cd83-401b-a412-e0c3e4204374 tempest-VolumeSnapshotQuotasNegativeTestJSON-1847884844 None] Lock "cinder-0bf37eb3-87a1-484c-aea4-4d6d92239fae-delete_volume" released by "delete_volume" :: held 0.669s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:20:54.600352 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:20:54.633713 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Flow 'volume_create_manager' (4ed1a1c9-b886-46e6-813c-dbe9df258726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:20:54.640797 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8494c2c-4ab0-4a71-8347-a9ffc94384a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:54.667810 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8494c2c-4ab0-4a71-8347-a9ffc94384a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1734745784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b6d0b3bc-1dfb-4679-9be8-0d135fb7c9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf93e783b8b4089af630ee60b8d0633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:20:55Z,use_quota=True,user_id='29f9d97aaec1482b8be6ac44c876f218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:54.676512 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e3fb93-dc68-4a33-a93d-8e57cd5c85c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:54.682811 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e3fb93-dc68-4a33-a93d-8e57cd5c85c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:54.689318 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ce7ade-380c-474d-94dd-8d4c83806451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:54.694218 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ce7ade-380c-474d-94dd-8d4c83806451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6d0b3bc-1dfb-4679-9be8-0d135fb7c9dc', 'volume_name': 'volume-b6d0b3bc-1dfb-4679-9be8-0d135fb7c9dc', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:54.699588 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec2f16c-69c5-4c7c-a33f-f89ffde04a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:54.704080 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec2f16c-69c5-4c7c-a33f-f89ffde04a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:54.709239 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25614917-b3a8-4106-bb4d-2074ac2fa799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:54.710382 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Volume b6d0b3bc-1dfb-4679-9be8-0d135fb7c9dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6d0b3bc-1dfb-4679-9be8-0d135fb7c9dc', 'volume_size': 1}
Oct 29 21:20:54.711015 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] creating volume 'volume-b6d0b3bc-1dfb-4679-9be8-0d135fb7c9dc' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:20:54.711762 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:54.811928 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:20:54.812335 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:20:54.816295 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25614917-b3a8-4106-bb4d-2074ac2fa799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d0b3bc-1dfb-4679-9be8-0d135fb7c9dc', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:54.821650 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60457cf-4c4d-484f-b047-e86eaa761981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:20:54.853075 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Volume volume-b6d0b3bc-1dfb-4679-9be8-0d135fb7c9dc (b6d0b3bc-1dfb-4679-9be8-0d135fb7c9dc): created successfully
Oct 29 21:20:54.860288 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60457cf-4c4d-484f-b047-e86eaa761981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:20:54.867445 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Flow 'volume_create_manager' (4ed1a1c9-b886-46e6-813c-dbe9df258726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:20:54.882023 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-ced9944b-f7f8-47cb-b448-ce4827b2b74c tempest-VolumesDeleteCascade-692067699 None] Created volume successfully.
Oct 29 21:20:55.902480 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-80e76507-dce5-4abd-95de-480278fe7e6b tempest-VolumesDeleteCascade-692067699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:57.032396 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-80e76507-dce5-4abd-95de-480278fe7e6b tempest-VolumesDeleteCascade-692067699 None] Create snapshot completed successfully
Oct 29 21:20:58.184798 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=63,cinder:INSERT=8,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:20:58.227800 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4f2182e9-e5e7-408b-8931-2e56cc448b45 tempest-VolumesDeleteCascade-692067699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:20:59.019753 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4f2182e9-e5e7-408b-8931-2e56cc448b45 tempest-VolumesDeleteCascade-692067699 None] Create snapshot completed successfully
Oct 29 21:20:59.361704 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Acquiring lock "cinder-b6d0b3bc-1dfb-4679-9be8-0d135fb7c9dc-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:20:59.374726 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Lock "cinder-b6d0b3bc-1dfb-4679-9be8-0d135fb7c9dc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:20:59.415573 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Performing cascade delete. {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1008}}
Oct 29 21:20:59.429898 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Acquiring lock "cinder-221ef346-fcbe-428a-bd54-4ff5271797a2-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:20:59.442345 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Lock "cinder-221ef346-fcbe-428a-bd54-4ff5271797a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:20:59.458382 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:00.028455 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Created reservations ['f6deb736-20eb-4a8d-a09d-ea7e1cf01e35', '2c028892-7cba-4063-b1ef-059db3aee8dc', 'a04712ef-5826-42df-894d-e1769a0e8a5c', 'aceb4786-d17b-452d-99dd-322fea8c260d'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:21:00.080194 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=56,cinder:UPDATE=31,cinder:DELETE=5,cinder:INSERT=8 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:21:00.094904 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Delete snapshot completed successfully.
Oct 29 21:21:00.102167 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Lock "cinder-221ef346-fcbe-428a-bd54-4ff5271797a2-delete_snapshot" released by "delete_snapshot" :: held 0.663s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:21:00.103304 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Acquiring lock "cinder-923ab5a6-dac1-4464-97ef-8f1498b7c5bb-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:21:00.113954 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Lock "cinder-923ab5a6-dac1-4464-97ef-8f1498b7c5bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:21:00.129546 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:01.033865 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Created reservations ['de18a865-f39b-4893-840f-ff59f817e3ec', 'd65ddff1-89d3-4f0c-80a4-949e8a058624', '3aeee3a2-f739-4e43-9ca3-0d907e8315fc', '26ad91a2-2057-4dc0-b040-f5728e648976'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:21:01.118269 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Delete snapshot completed successfully.
Oct 29 21:21:01.126054 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Lock "cinder-923ab5a6-dac1-4464-97ef-8f1498b7c5bb-delete_snapshot" released by "delete_snapshot" :: held 1.012s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:21:01.128262 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Snapshots deleted, issuing volume delete {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1023}}
Oct 29 21:21:01.129907 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:01.209269 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:21:01.210125 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Volume volume-b6d0b3bc-1dfb-4679-9be8-0d135fb7c9dc is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:21:01.218744 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] deleting rbd volume volume-b6d0b3bc-1dfb-4679-9be8-0d135fb7c9dc {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:21:01.404947 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:21:01.407698 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:01.482603 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:01.576663 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:21:01.670154 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Created reservations ['a8cd23ae-8bd6-40ca-974a-39486637da46', 'ec683635-235d-483b-8f4f-6a10e24fb619', 'f08d8fe0-0fe6-4629-b089-2d60316d836c', '9dfaea01-aa7d-46c5-9d9f-33d4484d818a'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:21:01.775873 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:01.836213 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:01.886727 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:21:01.894162 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Deleted volume successfully.
Oct 29 21:21:01.914366 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c36af392-8eb6-46b3-900e-a0e8b974aded tempest-VolumesDeleteCascade-692067699 None] Lock "cinder-b6d0b3bc-1dfb-4679-9be8-0d135fb7c9dc-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:21:05.285478 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:21:05.309835 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Flow 'volume_create_manager' (e81eff78-b03a-4713-915c-6724b43feaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:05.322045 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bee3907-59ce-46ef-bf20-37b41180c52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:05.340278 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bee3907-59ce-46ef-bf20-37b41180c52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-807369397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f45ecd92-7433-4a8c-8db1-4a94917f5350,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0caf7e94c21641e394969d8932e8154d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:21:05Z,use_quota=True,user_id='0bd7e9d00a334185a5365551b5d48a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:05.346979 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238de79d-cea9-421a-8e7e-3e747e2d1764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:05.351726 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (238de79d-cea9-421a-8e7e-3e747e2d1764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:05.357292 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2098ac3a-7d40-47fa-ba5a-198258133a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:05.361824 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2098ac3a-7d40-47fa-ba5a-198258133a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f45ecd92-7433-4a8c-8db1-4a94917f5350', 'volume_name': 'volume-f45ecd92-7433-4a8c-8db1-4a94917f5350', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:05.368125 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89704226-3e6a-4a9e-a3f5-87191cc51051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:05.373418 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89704226-3e6a-4a9e-a3f5-87191cc51051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:05.378033 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d41af5-2836-4dae-8ae8-b6db38fa96c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:05.379099 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Volume f45ecd92-7433-4a8c-8db1-4a94917f5350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f45ecd92-7433-4a8c-8db1-4a94917f5350', 'volume_size': 1}
Oct 29 21:21:05.379497 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] creating volume 'volume-f45ecd92-7433-4a8c-8db1-4a94917f5350' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:21:05.380262 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:05.446662 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:21:05.447478 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:21:05.452117 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d41af5-2836-4dae-8ae8-b6db38fa96c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f45ecd92-7433-4a8c-8db1-4a94917f5350', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:05.456241 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8641935-f612-4851-bc91-79eec47a39ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:05.466532 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Volume volume-f45ecd92-7433-4a8c-8db1-4a94917f5350 (f45ecd92-7433-4a8c-8db1-4a94917f5350): created successfully
Oct 29 21:21:05.470437 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8641935-f612-4851-bc91-79eec47a39ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:05.475655 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Flow 'volume_create_manager' (e81eff78-b03a-4713-915c-6724b43feaf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:05.486069 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-ebea64e0-29eb-4043-b7fd-eee2d6162cad tempest-VolumesGetTest-1870624693 None] Created volume successfully.
Oct 29 21:21:07.338252 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:21:07.368943 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Flow 'volume_create_manager' (e25ed1b5-f7a7-46af-bdbc-64084c6786ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:07.379309 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6d0e20-1897-4886-9cb1-11d9408afe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:07.400654 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6d0e20-1897-4886-9cb1-11d9408afe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:21:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-130816269',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5e4b6eee-dda2-4d13-b692-5c511949fa6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0caf7e94c21641e394969d8932e8154d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:21:07Z,use_quota=True,user_id='0bd7e9d00a334185a5365551b5d48a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:07.406726 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9085a91-7889-4af3-b6a1-f232f4479c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:07.410786 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9085a91-7889-4af3-b6a1-f232f4479c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:07.415854 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf907401-1d5e-449a-bc23-88b0616c2c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:07.420721 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf907401-1d5e-449a-bc23-88b0616c2c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e4b6eee-dda2-4d13-b692-5c511949fa6d', 'volume_name': 'volume-5e4b6eee-dda2-4d13-b692-5c511949fa6d', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:07.426253 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698c2676-e284-493f-8333-5e74ceca6239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:07.430546 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698c2676-e284-493f-8333-5e74ceca6239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:07.435925 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a655f3-ef84-4c3a-be44-da6cd208b3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:07.437791 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Volume 5e4b6eee-dda2-4d13-b692-5c511949fa6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e4b6eee-dda2-4d13-b692-5c511949fa6d', 'volume_size': 1}
Oct 29 21:21:07.438369 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] creating volume 'volume-5e4b6eee-dda2-4d13-b692-5c511949fa6d' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:21:07.439165 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:07.557421 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:21:07.558113 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:21:07.562665 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a655f3-ef84-4c3a-be44-da6cd208b3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e4b6eee-dda2-4d13-b692-5c511949fa6d', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:07.567991 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04b6d72-6840-46a3-ba67-5a8693e8f97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:07.580311 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Volume volume-5e4b6eee-dda2-4d13-b692-5c511949fa6d (5e4b6eee-dda2-4d13-b692-5c511949fa6d): created successfully
Oct 29 21:21:07.583877 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04b6d72-6840-46a3-ba67-5a8693e8f97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:07.594155 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Flow 'volume_create_manager' (e25ed1b5-f7a7-46af-bdbc-64084c6786ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:07.624812 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-86e439c6-ecac-4680-bf3a-298819dd8611 tempest-VolumesGetTest-1870624693 None] Created volume successfully.
Oct 29 21:21:08.509435 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-64a7fb7b-1b61-4824-ac0c-9735b4738a58 tempest-VolumesGetTest-1870624693 None] Acquiring lock "cinder-5e4b6eee-dda2-4d13-b692-5c511949fa6d-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:21:08.528227 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-64a7fb7b-1b61-4824-ac0c-9735b4738a58 tempest-VolumesGetTest-1870624693 None] Lock "cinder-5e4b6eee-dda2-4d13-b692-5c511949fa6d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:21:08.609419 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-64a7fb7b-1b61-4824-ac0c-9735b4738a58 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:08.710153 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-64a7fb7b-1b61-4824-ac0c-9735b4738a58 tempest-VolumesGetTest-1870624693 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:21:08.710733 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-64a7fb7b-1b61-4824-ac0c-9735b4738a58 tempest-VolumesGetTest-1870624693 None] Volume volume-5e4b6eee-dda2-4d13-b692-5c511949fa6d is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:21:08.718855 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-64a7fb7b-1b61-4824-ac0c-9735b4738a58 tempest-VolumesGetTest-1870624693 None] deleting rbd volume volume-5e4b6eee-dda2-4d13-b692-5c511949fa6d {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:21:09.058209 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-64a7fb7b-1b61-4824-ac0c-9735b4738a58 tempest-VolumesGetTest-1870624693 None] Created reservations ['01da7878-d663-4953-bd5e-70f225e00a7c', 'e4c1fc60-145c-4817-ba64-e3db97b95857', 'fd018532-0f35-425b-aa62-d86fdfffa0bb', '6155acef-c360-4a0f-b5e4-093105a25bdb'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:21:09.123100 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-64a7fb7b-1b61-4824-ac0c-9735b4738a58 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:09.168441 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-64a7fb7b-1b61-4824-ac0c-9735b4738a58 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:09.221719 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-64a7fb7b-1b61-4824-ac0c-9735b4738a58 tempest-VolumesGetTest-1870624693 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:21:09.234936 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-64a7fb7b-1b61-4824-ac0c-9735b4738a58 tempest-VolumesGetTest-1870624693 None] Deleted volume successfully.
Oct 29 21:21:09.253995 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-64a7fb7b-1b61-4824-ac0c-9735b4738a58 tempest-VolumesGetTest-1870624693 None] Lock "cinder-5e4b6eee-dda2-4d13-b692-5c511949fa6d-delete_volume" released by "delete_volume" :: held 0.725s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:21:09.742249 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-7585282c-b6f6-418a-9641-bf7bd1ef1150 tempest-VolumesGetTest-1870624693 None] Acquiring lock "cinder-f45ecd92-7433-4a8c-8db1-4a94917f5350-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:21:09.760035 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-7585282c-b6f6-418a-9641-bf7bd1ef1150 tempest-VolumesGetTest-1870624693 None] Lock "cinder-f45ecd92-7433-4a8c-8db1-4a94917f5350-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:21:09.808473 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7585282c-b6f6-418a-9641-bf7bd1ef1150 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:09.860571 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7585282c-b6f6-418a-9641-bf7bd1ef1150 tempest-VolumesGetTest-1870624693 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:21:09.861035 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7585282c-b6f6-418a-9641-bf7bd1ef1150 tempest-VolumesGetTest-1870624693 None] Volume volume-f45ecd92-7433-4a8c-8db1-4a94917f5350 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:21:09.866932 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7585282c-b6f6-418a-9641-bf7bd1ef1150 tempest-VolumesGetTest-1870624693 None] deleting rbd volume volume-f45ecd92-7433-4a8c-8db1-4a94917f5350 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:21:10.060398 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=58,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=8 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:21:10.111629 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-7585282c-b6f6-418a-9641-bf7bd1ef1150 tempest-VolumesGetTest-1870624693 None] Created reservations ['3d424f41-1e9b-4f56-99a5-ed4ad0df5cfb', '51f69655-53c9-491a-92c7-c5f068367dea', '52ea7ed8-51de-4ae0-9b60-67538f18baa2', '9bba1885-638a-46c7-906f-cc9d001c3362'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:21:10.170286 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=56,cinder:INSERT=5,cinder:UPDATE=38,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:21:10.179098 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7585282c-b6f6-418a-9641-bf7bd1ef1150 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:10.259509 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7585282c-b6f6-418a-9641-bf7bd1ef1150 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:10.297110 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-7585282c-b6f6-418a-9641-bf7bd1ef1150 tempest-VolumesGetTest-1870624693 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:21:10.303381 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7585282c-b6f6-418a-9641-bf7bd1ef1150 tempest-VolumesGetTest-1870624693 None] Deleted volume successfully.
Oct 29 21:21:10.325906 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-7585282c-b6f6-418a-9641-bf7bd1ef1150 tempest-VolumesGetTest-1870624693 None] Lock "cinder-f45ecd92-7433-4a8c-8db1-4a94917f5350-delete_volume" released by "delete_volume" :: held 0.566s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:21:11.036216 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-32b55b08-28b8-4fe4-b2f5-ea362125d52f tempest-TestVolumeBootPattern-1121030847 None] Created reservations ['347aaf48-a4f0-4e35-aafc-fabe36324350', '5c9930b1-4c48-4a68-88dc-87e7c1b4ab93', 'b0753bc2-39c0-4008-8e83-98ebd15c09cc', 'bbceeec2-10c6-4c72-a4a3-928451b7e327'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:21:11.095435 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-32b55b08-28b8-4fe4-b2f5-ea362125d52f tempest-TestVolumeBootPattern-1121030847 None] Delete snapshot completed successfully.
Oct 29 21:21:11.101300 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-32b55b08-28b8-4fe4-b2f5-ea362125d52f tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-f73a835b-6da5-4752-928d-e711f4fbd229-delete_snapshot" released by "delete_snapshot" :: held 30.324s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:21:11.491186 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:21:11.513957 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Flow 'volume_create_manager' (e780d710-6195-4a9c-bcb6-bb49fb83b85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:11.520712 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666a1f8a-c9a8-4a6f-b220-2bf7c58ec1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:11.540390 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (666a1f8a-c9a8-4a6f-b220-2bf7c58ec1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1323539009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ac6c000d-041f-4b07-ab5a-522354fed135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0caf7e94c21641e394969d8932e8154d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:21:11Z,use_quota=True,user_id='0bd7e9d00a334185a5365551b5d48a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:11.546312 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5564288-7a2a-49aa-8b69-b90b5432f576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:11.550440 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5564288-7a2a-49aa-8b69-b90b5432f576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:11.555694 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a4a230-18fd-4d61-9e4b-a0ae7c7b795b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:11.559795 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a4a230-18fd-4d61-9e4b-a0ae7c7b795b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac6c000d-041f-4b07-ab5a-522354fed135', 'volume_name': 'volume-ac6c000d-041f-4b07-ab5a-522354fed135', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:11.564636 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecd28eb-41dc-473f-aa0e-67c35b2dd098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:11.568484 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecd28eb-41dc-473f-aa0e-67c35b2dd098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:11.573184 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebacaa97-6cbb-4a77-9e8c-395b0513f841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:11.574271 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Volume ac6c000d-041f-4b07-ab5a-522354fed135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac6c000d-041f-4b07-ab5a-522354fed135', 'volume_size': 1}
Oct 29 21:21:11.574722 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] creating volume 'volume-ac6c000d-041f-4b07-ab5a-522354fed135' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:21:11.575675 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:11.653084 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:21:11.653420 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:21:11.658106 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebacaa97-6cbb-4a77-9e8c-395b0513f841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac6c000d-041f-4b07-ab5a-522354fed135', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:11.663316 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8568555-69b6-4d99-aee7-ec610b72ff18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:11.681100 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Volume volume-ac6c000d-041f-4b07-ab5a-522354fed135 (ac6c000d-041f-4b07-ab5a-522354fed135): created successfully
Oct 29 21:21:11.685138 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8568555-69b6-4d99-aee7-ec610b72ff18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:11.691187 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Flow 'volume_create_manager' (e780d710-6195-4a9c-bcb6-bb49fb83b85d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:11.700563 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-8c9aeff7-3f18-4863-8bea-f156926d119e tempest-VolumesGetTest-1870624693 None] Created volume successfully.
Oct 29 21:21:13.021891 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:21:13.060623 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Flow 'volume_create_manager' (6e05be83-c60a-4e69-b9dc-8ecd5ad3bab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:13.069125 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d699eb-c472-42e2-b94b-aebb8d010c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:13.090076 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d699eb-c472-42e2-b94b-aebb8d010c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1962743535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=82f78e5f-4f72-4a16-9562-2f5b67f715a3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0caf7e94c21641e394969d8932e8154d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=ac6c000d-041f-4b07-ab5a-522354fed135,status='creating',terminated_at=None,updated_at=2022-10-29T21:21:13Z,use_quota=True,user_id='0bd7e9d00a334185a5365551b5d48a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:13.095768 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d219e5da-10a5-47ef-93a2-ad4f08269651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:13.099975 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d219e5da-10a5-47ef-93a2-ad4f08269651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:13.105174 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2dac4c-ed81-4433-b823-4b2c5736c67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:13.125023 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2dac4c-ed81-4433-b823-4b2c5736c67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '82f78e5f-4f72-4a16-9562-2f5b67f715a3', 'volume_name': 'volume-82f78e5f-4f72-4a16-9562-2f5b67f715a3', 'volume_size': 1, 'source_volid': 'ac6c000d-041f-4b07-ab5a-522354fed135', 'source_volstatus': 'available'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:13.130207 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd90bcda-0f32-4e9c-bf98-56adf56797ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:13.134283 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd90bcda-0f32-4e9c-bf98-56adf56797ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:13.140078 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9965c8e-486e-4293-b249-d7cc673313a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:13.142157 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Volume 82f78e5f-4f72-4a16-9562-2f5b67f715a3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-82f78e5f-4f72-4a16-9562-2f5b67f715a3', 'volume_size': 1, 'source_volid': 'ac6c000d-041f-4b07-ab5a-522354fed135', 'source_volstatus': 'available'}
Oct 29 21:21:13.155728 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:13.217073 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] creating snapshot='volume-82f78e5f-4f72-4a16-9562-2f5b67f715a3.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 21:21:13.729221 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] cloning 'volume-ac6c000d-041f-4b07-ab5a-522354fed135@volume-82f78e5f-4f72-4a16-9562-2f5b67f715a3.clone_snap' to 'volume-82f78e5f-4f72-4a16-9562-2f5b67f715a3' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 21:21:13.786039 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-a684d691-1b97-4cd6-bcfa-9508e82f012b req-e24689ae-74ef-4bbd-982a-89c711287a93 tempest-TestVolumeBootPattern-1121030847 None] Terminate volume connection completed successfully.
Oct 29 21:21:13.786708 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-a684d691-1b97-4cd6-bcfa-9508e82f012b req-e24689ae-74ef-4bbd-982a-89c711287a93 tempest-TestVolumeBootPattern-1121030847 None] Deleting attachment 9d7d6601-68e8-4885-8611-a149d72d9fc0. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:21:13.835333 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Volume volume-ac6c000d-041f-4b07-ab5a-522354fed135 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:21:13.837402 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:21:13.837883 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:21:13.854217 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 21:21:13.859147 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9965c8e-486e-4293-b249-d7cc673313a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f78e5f-4f72-4a16-9562-2f5b67f715a3', 'volume_size': 1, 'source_volid': 'ac6c000d-041f-4b07-ab5a-522354fed135', 'source_volstatus': 'available'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:13.864709 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42792ae-5848-4725-be9d-4546c045d934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:13.878944 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Volume volume-82f78e5f-4f72-4a16-9562-2f5b67f715a3 (82f78e5f-4f72-4a16-9562-2f5b67f715a3): created successfully
Oct 29 21:21:13.882933 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42792ae-5848-4725-be9d-4546c045d934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:13.888392 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Flow 'volume_create_manager' (6e05be83-c60a-4e69-b9dc-8ecd5ad3bab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:13.906929 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f99e5e3c-aa4e-4481-91ad-bf58df62df89 tempest-VolumesGetTest-1870624693 None] Created volume successfully.
Oct 29 21:21:14.007727 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-a684d691-1b97-4cd6-bcfa-9508e82f012b req-0091a351-b47d-4b74-a93d-cf8249fb1a12 tempest-TestVolumeBootPattern-1121030847 None] Acquiring lock "cinder-d77b83fc-0cf8-47e0-ab3e-e84abfe35d95-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:21:14.022360 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-a684d691-1b97-4cd6-bcfa-9508e82f012b req-0091a351-b47d-4b74-a93d-cf8249fb1a12 tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-d77b83fc-0cf8-47e0-ab3e-e84abfe35d95-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:21:14.069768 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-a684d691-1b97-4cd6-bcfa-9508e82f012b req-0091a351-b47d-4b74-a93d-cf8249fb1a12 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:14.182681 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-a684d691-1b97-4cd6-bcfa-9508e82f012b req-0091a351-b47d-4b74-a93d-cf8249fb1a12 tempest-TestVolumeBootPattern-1121030847 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:21:14.192101 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-a684d691-1b97-4cd6-bcfa-9508e82f012b req-0091a351-b47d-4b74-a93d-cf8249fb1a12 tempest-TestVolumeBootPattern-1121030847 None] deleting rbd volume volume-d77b83fc-0cf8-47e0-ab3e-e84abfe35d95 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:21:14.410952 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-a684d691-1b97-4cd6-bcfa-9508e82f012b req-0091a351-b47d-4b74-a93d-cf8249fb1a12 tempest-TestVolumeBootPattern-1121030847 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 21:21:14.439970 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-a684d691-1b97-4cd6-bcfa-9508e82f012b req-0091a351-b47d-4b74-a93d-cf8249fb1a12 tempest-TestVolumeBootPattern-1121030847 None] deleting parent snapshot volume-d77b83fc-0cf8-47e0-ab3e-e84abfe35d95.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 21:21:14.772261 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [req-a684d691-1b97-4cd6-bcfa-9508e82f012b req-0091a351-b47d-4b74-a93d-cf8249fb1a12 tempest-TestVolumeBootPattern-1121030847 None] Created reservations ['8f66f1c6-cf5a-4031-989b-47ed802b01c1', 'bcb52ad3-2a82-40a7-a844-421920a6bc7b', '76179f43-970d-4969-ab60-6f192bb8fafa', 'bde67cec-70bc-4be3-9569-7dcd1fcefb42'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:21:14.819944 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-a684d691-1b97-4cd6-bcfa-9508e82f012b req-0091a351-b47d-4b74-a93d-cf8249fb1a12 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:14.848654 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-a684d691-1b97-4cd6-bcfa-9508e82f012b req-0091a351-b47d-4b74-a93d-cf8249fb1a12 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:14.879581 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [req-a684d691-1b97-4cd6-bcfa-9508e82f012b req-0091a351-b47d-4b74-a93d-cf8249fb1a12 tempest-TestVolumeBootPattern-1121030847 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:21:14.883687 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-a684d691-1b97-4cd6-bcfa-9508e82f012b req-0091a351-b47d-4b74-a93d-cf8249fb1a12 tempest-TestVolumeBootPattern-1121030847 None] Deleted volume successfully.
Oct 29 21:21:14.897637 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-a684d691-1b97-4cd6-bcfa-9508e82f012b req-0091a351-b47d-4b74-a93d-cf8249fb1a12 tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-d77b83fc-0cf8-47e0-ab3e-e84abfe35d95-delete_volume" released by "delete_volume" :: held 0.875s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:21:15.614439 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:21:15.642509 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Flow 'volume_create_manager' (a0198427-8685-4388-b058-17b55de55be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:15.652525 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02a2b45-b73f-4d73-af89-4be2882e6c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:15.668863 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02a2b45-b73f-4d73-af89-4be2882e6c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:21:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1006368374',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=713b823c-3a7d-4e55-a7f2-b11129ebce13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0caf7e94c21641e394969d8932e8154d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:21:16Z,use_quota=True,user_id='0bd7e9d00a334185a5365551b5d48a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:15.675287 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a1f6c2-9b06-4187-b416-b95abd3ccec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:15.679951 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a1f6c2-9b06-4187-b416-b95abd3ccec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:15.685335 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a2f452-64de-4ac5-855a-9f0633419514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:15.692096 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a2f452-64de-4ac5-855a-9f0633419514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '713b823c-3a7d-4e55-a7f2-b11129ebce13', 'volume_name': 'volume-713b823c-3a7d-4e55-a7f2-b11129ebce13', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:15.699984 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d750c8de-c50e-44bf-b3b3-5037dac1f806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:15.705007 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d750c8de-c50e-44bf-b3b3-5037dac1f806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:15.710667 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff56bc7-7e3c-4278-b2d3-b7f6b0b5ef9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:15.712047 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Volume 713b823c-3a7d-4e55-a7f2-b11129ebce13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-713b823c-3a7d-4e55-a7f2-b11129ebce13', 'volume_size': 1}
Oct 29 21:21:15.712659 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] creating volume 'volume-713b823c-3a7d-4e55-a7f2-b11129ebce13' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:21:15.713974 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:15.798787 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:21:15.799187 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:21:15.808025 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff56bc7-7e3c-4278-b2d3-b7f6b0b5ef9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-713b823c-3a7d-4e55-a7f2-b11129ebce13', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:15.812762 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531bb2c8-e728-4338-8e97-aa266196deb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:15.826245 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Volume volume-713b823c-3a7d-4e55-a7f2-b11129ebce13 (713b823c-3a7d-4e55-a7f2-b11129ebce13): created successfully
Oct 29 21:21:15.830977 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (531bb2c8-e728-4338-8e97-aa266196deb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:15.836883 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Flow 'volume_create_manager' (a0198427-8685-4388-b058-17b55de55be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:15.852517 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-3f474b5b-57d6-463c-bb5d-5c4879bc2b19 tempest-VolumesGetTest-1870624693 None] Created volume successfully.
Oct 29 21:21:16.799216 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-5d0cdeed-dda5-4936-831c-3231d0e252ef tempest-VolumesGetTest-1870624693 None] Acquiring lock "cinder-713b823c-3a7d-4e55-a7f2-b11129ebce13-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:21:16.848800 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-5d0cdeed-dda5-4936-831c-3231d0e252ef tempest-VolumesGetTest-1870624693 None] Lock "cinder-713b823c-3a7d-4e55-a7f2-b11129ebce13-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:21:16.925200 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5d0cdeed-dda5-4936-831c-3231d0e252ef tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:17.007843 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5d0cdeed-dda5-4936-831c-3231d0e252ef tempest-VolumesGetTest-1870624693 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:21:17.008269 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5d0cdeed-dda5-4936-831c-3231d0e252ef tempest-VolumesGetTest-1870624693 None] Volume volume-713b823c-3a7d-4e55-a7f2-b11129ebce13 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:21:17.020099 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5d0cdeed-dda5-4936-831c-3231d0e252ef tempest-VolumesGetTest-1870624693 None] deleting rbd volume volume-713b823c-3a7d-4e55-a7f2-b11129ebce13 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:21:17.236165 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-5d0cdeed-dda5-4936-831c-3231d0e252ef tempest-VolumesGetTest-1870624693 None] Created reservations ['bd021c93-2953-4106-8adf-38bfe20ed953', 'dfb5b43f-db68-4934-bc88-389cf9af7efa', 'db740ee1-0085-4c80-a7db-37cdf63d4834', '7e8a7828-48cd-42a7-8052-df0f939753d6'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:21:17.291026 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=60,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:21:17.313374 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5d0cdeed-dda5-4936-831c-3231d0e252ef tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:17.373384 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5d0cdeed-dda5-4936-831c-3231d0e252ef tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:17.415811 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-5d0cdeed-dda5-4936-831c-3231d0e252ef tempest-VolumesGetTest-1870624693 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:21:17.422848 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-5d0cdeed-dda5-4936-831c-3231d0e252ef tempest-VolumesGetTest-1870624693 None] Deleted volume successfully.
Oct 29 21:21:17.444351 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-5d0cdeed-dda5-4936-831c-3231d0e252ef tempest-VolumesGetTest-1870624693 None] Lock "cinder-713b823c-3a7d-4e55-a7f2-b11129ebce13-delete_volume" released by "delete_volume" :: held 0.596s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:21:18.050410 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-36f3b7b1-0a7f-426f-97aa-ddfec217fc88 tempest-VolumesGetTest-1870624693 None] Acquiring lock "cinder-82f78e5f-4f72-4a16-9562-2f5b67f715a3-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:21:18.067280 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-36f3b7b1-0a7f-426f-97aa-ddfec217fc88 tempest-VolumesGetTest-1870624693 None] Lock "cinder-82f78e5f-4f72-4a16-9562-2f5b67f715a3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:21:18.134555 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-36f3b7b1-0a7f-426f-97aa-ddfec217fc88 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:18.218341 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-36f3b7b1-0a7f-426f-97aa-ddfec217fc88 tempest-VolumesGetTest-1870624693 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:21:18.226024 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-36f3b7b1-0a7f-426f-97aa-ddfec217fc88 tempest-VolumesGetTest-1870624693 None] deleting rbd volume volume-82f78e5f-4f72-4a16-9562-2f5b67f715a3 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:21:18.435894 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-36f3b7b1-0a7f-426f-97aa-ddfec217fc88 tempest-VolumesGetTest-1870624693 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 21:21:18.466550 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-36f3b7b1-0a7f-426f-97aa-ddfec217fc88 tempest-VolumesGetTest-1870624693 None] Volume volume-ac6c000d-041f-4b07-ab5a-522354fed135 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:21:18.468005 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-36f3b7b1-0a7f-426f-97aa-ddfec217fc88 tempest-VolumesGetTest-1870624693 None] deleting parent snapshot volume-82f78e5f-4f72-4a16-9562-2f5b67f715a3.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 21:21:18.864626 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:21:18.887615 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Flow 'volume_create_manager' (146a5033-c785-40ff-9dea-07af06f79e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:18.894503 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a53e0d8-9281-4562-8c50-e52522b47f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:18.918493 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a53e0d8-9281-4562-8c50-e52522b47f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-401429571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1dd52dee-26a8-4479-b52c-88863fc657c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1eca42e66ec4ad1b747ef6027e894df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:21:19Z,use_quota=True,user_id='1254ce210eae494b8c2bfc925b9978c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:18.924365 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aae4122-0615-4a6d-90c7-f3e87b585c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:18.928699 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aae4122-0615-4a6d-90c7-f3e87b585c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:18.934654 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7418ab-7a95-462f-b787-c9ac426a44fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:18.947325 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=56,cinder:INSERT=10,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:21:18.953575 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-36f3b7b1-0a7f-426f-97aa-ddfec217fc88 tempest-VolumesGetTest-1870624693 None] Created reservations ['50dc6b74-c961-4d3f-b233-1e5f92e99e4a', '0b87d274-d604-4c12-8051-a9ff0a0858bd', 'f00c49dc-516d-41ae-9e3c-f56aee4d7a9d', '485c93db-8389-4bd3-9afc-54c69d77a34e'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:21:19.064179 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-36f3b7b1-0a7f-426f-97aa-ddfec217fc88 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:19.127982 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7418ab-7a95-462f-b787-c9ac426a44fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1dd52dee-26a8-4479-b52c-88863fc657c0', 'volume_name': 'volume-1dd52dee-26a8-4479-b52c-88863fc657c0', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93468daee0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:19.134323 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94557a0-f0c3-4184-9806-d0be0ba81436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:19.137596 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94557a0-f0c3-4184-9806-d0be0ba81436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:19.142907 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563e8a21-ebfd-4868-847e-c7397ccb42cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:19.144201 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Volume 1dd52dee-26a8-4479-b52c-88863fc657c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1dd52dee-26a8-4479-b52c-88863fc657c0', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93468daee0>}
Oct 29 21:21:19.144815 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Cloning 1dd52dee-26a8-4479-b52c-88863fc657c0 from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 21:21:19.146033 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:21:19.150115 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-36f3b7b1-0a7f-426f-97aa-ddfec217fc88 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:19.234021 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-36f3b7b1-0a7f-426f-97aa-ddfec217fc88 tempest-VolumesGetTest-1870624693 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:21:19.249615 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-36f3b7b1-0a7f-426f-97aa-ddfec217fc88 tempest-VolumesGetTest-1870624693 None] Deleted volume successfully.
Oct 29 21:21:19.259164 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.113s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:21:19.297915 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-36f3b7b1-0a7f-426f-97aa-ddfec217fc88 tempest-VolumesGetTest-1870624693 None] Lock "cinder-82f78e5f-4f72-4a16-9562-2f5b67f715a3-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:21:19.299891 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 21, 19, 287641)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:21:19.300327 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:21:19.300940 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Found cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 29 21:21:19.306757 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 0.048s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:21:19.307974 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 21:21:19.320979 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 21, 19, 313214)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:21:19.321754 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:21:19.322245 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Creating from source image-volume fbe0dd2e-351a-4779-844d-3c66baf14939 {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 29 21:21:19.347124 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:19.442730 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] creating snapshot='volume-1dd52dee-26a8-4479-b52c-88863fc657c0.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 21:21:19.805993 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] cloning 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939@volume-1dd52dee-26a8-4479-b52c-88863fc657c0.clone_snap' to 'volume-1dd52dee-26a8-4479-b52c-88863fc657c0' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 21:21:19.829802 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:21:19.849963 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Flow 'volume_create_manager' (d6a0e15b-3bfb-4792-8031-9ad3ce600316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:19.856457 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c2276d-d670-4cd6-b961-c4adcda52f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:19.877387 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c2276d-d670-4cd6-b961-c4adcda52f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-245081849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f092e226-2e3f-4fc8-9c27-2bae92ff0608,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0caf7e94c21641e394969d8932e8154d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:21:20Z,use_quota=True,user_id='0bd7e9d00a334185a5365551b5d48a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:19.884152 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5aee58-73e0-41ef-8429-99dcc7403c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:19.894644 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5aee58-73e0-41ef-8429-99dcc7403c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:19.900243 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a272897b-81e9-41ec-8e13-8ce3e60b2e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:19.966525 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:21:19.968429 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:21:19.968893 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:21:19.992103 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 21:21:19.992742 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Marking volume 1dd52dee-26a8-4479-b52c-88863fc657c0 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 21:21:20.015562 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to 1dd52dee-26a8-4479-b52c-88863fc657c0. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 21:21:20.015970 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Creating volume glance metadata for volume 1dd52dee-26a8-4479-b52c-88863fc657c0 backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 21:21:20.103454 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563e8a21-ebfd-4868-847e-c7397ccb42cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dd52dee-26a8-4479-b52c-88863fc657c0', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93468daee0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:20.108258 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67f93c1-2b1f-4d03-b765-34cccc2f48f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:20.117257 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a272897b-81e9-41ec-8e13-8ce3e60b2e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f092e226-2e3f-4fc8-9c27-2bae92ff0608', 'volume_name': 'volume-f092e226-2e3f-4fc8-9c27-2bae92ff0608', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93467067c0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:20.122151 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ea9559-f11b-4313-8196-5acbe4157a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:20.126257 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ea9559-f11b-4313-8196-5acbe4157a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:20.130863 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3441b052-b23f-4975-bc99-04a0b5f0d92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:20.132037 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Volume f092e226-2e3f-4fc8-9c27-2bae92ff0608: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f092e226-2e3f-4fc8-9c27-2bae92ff0608', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93467067c0>}
Oct 29 21:21:20.132612 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Cloning f092e226-2e3f-4fc8-9c27-2bae92ff0608 from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 21:21:20.133260 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:21:20.144362 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:21:20.148083 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Volume volume-1dd52dee-26a8-4479-b52c-88863fc657c0 (1dd52dee-26a8-4479-b52c-88863fc657c0): created successfully
Oct 29 21:21:20.151669 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67f93c1-2b1f-4d03-b765-34cccc2f48f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:20.157615 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Flow 'volume_create_manager' (146a5033-c785-40ff-9dea-07af06f79e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:20.170317 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 21, 20, 161154)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:21:20.170780 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:21:20.171181 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Found cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 29 21:21:20.175392 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-94b19dab-4cbe-4c58-b5c6-3fb7255d73fe tempest-TestVolumeBootPattern-1121030847 None] Created volume successfully.
Oct 29 21:21:20.178183 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 0.034s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:21:20.178837 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 21:21:20.185101 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 21, 20, 182540)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:21:20.185557 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:21:20.185962 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Creating from source image-volume fbe0dd2e-351a-4779-844d-3c66baf14939 {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 29 21:21:20.201143 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:20.273975 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] creating snapshot='volume-f092e226-2e3f-4fc8-9c27-2bae92ff0608.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 21:21:20.878341 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] cloning 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939@volume-f092e226-2e3f-4fc8-9c27-2bae92ff0608.clone_snap' to 'volume-f092e226-2e3f-4fc8-9c27-2bae92ff0608' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 21:21:21.074109 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:21:21.075765 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:21:21.076203 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:21:21.096097 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 21:21:21.096943 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Marking volume f092e226-2e3f-4fc8-9c27-2bae92ff0608 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 21:21:21.109013 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to f092e226-2e3f-4fc8-9c27-2bae92ff0608. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 21:21:21.111033 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Creating volume glance metadata for volume f092e226-2e3f-4fc8-9c27-2bae92ff0608 backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 21:21:21.190398 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3441b052-b23f-4975-bc99-04a0b5f0d92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f092e226-2e3f-4fc8-9c27-2bae92ff0608', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93467067c0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:21.196949 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5a8cab-105f-402a-ac69-0f6dbc7c756d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:21.215085 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Volume volume-f092e226-2e3f-4fc8-9c27-2bae92ff0608 (f092e226-2e3f-4fc8-9c27-2bae92ff0608): created successfully
Oct 29 21:21:21.231285 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5a8cab-105f-402a-ac69-0f6dbc7c756d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:21.239707 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Flow 'volume_create_manager' (d6a0e15b-3bfb-4792-8031-9ad3ce600316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:21.258706 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-22b848b3-50a2-4422-9751-cfe6b6b46d64 tempest-VolumesGetTest-1870624693 None] Created volume successfully.
Oct 29 21:21:22.829854 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:21:22.872347 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Flow 'volume_create_manager' (af6cf16f-e27a-4bdd-8ae7-693ea97f2608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:22.881825 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37caaf20-7e9a-46ab-b017-669db1b42d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:22.938734 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37caaf20-7e9a-46ab-b017-669db1b42d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:21:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-866907992',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=83fb3bc2-2c76-43e8-877b-41314e37c47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0caf7e94c21641e394969d8932e8154d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:21:23Z,use_quota=True,user_id='0bd7e9d00a334185a5365551b5d48a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:22.946752 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b2ef879-10a2-40a4-856d-199d5892c597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:22.954362 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b2ef879-10a2-40a4-856d-199d5892c597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:22.961361 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83c1622-1807-4ad8-9a51-6c8b83e60d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:22.968154 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d83c1622-1807-4ad8-9a51-6c8b83e60d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83fb3bc2-2c76-43e8-877b-41314e37c47c', 'volume_name': 'volume-83fb3bc2-2c76-43e8-877b-41314e37c47c', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:22.973800 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4e86a4-63c9-47ed-8449-6c792657dad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:22.978270 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4e86a4-63c9-47ed-8449-6c792657dad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:22.984041 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc3830d-bf0e-47cf-a8be-8b6edfb38f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:22.985355 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Volume 83fb3bc2-2c76-43e8-877b-41314e37c47c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83fb3bc2-2c76-43e8-877b-41314e37c47c', 'volume_size': 1}
Oct 29 21:21:22.985939 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] creating volume 'volume-83fb3bc2-2c76-43e8-877b-41314e37c47c' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:21:22.986869 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:23.105813 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:21:23.106420 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:21:23.111378 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc3830d-bf0e-47cf-a8be-8b6edfb38f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83fb3bc2-2c76-43e8-877b-41314e37c47c', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:23.119013 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3214d8f-902b-4bfc-9edd-11a8c180c604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:23.143652 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Volume volume-83fb3bc2-2c76-43e8-877b-41314e37c47c (83fb3bc2-2c76-43e8-877b-41314e37c47c): created successfully
Oct 29 21:21:23.147983 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3214d8f-902b-4bfc-9edd-11a8c180c604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:23.154970 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Flow 'volume_create_manager' (af6cf16f-e27a-4bdd-8ae7-693ea97f2608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:23.167053 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-21b649e3-1ec9-429a-807f-77495cb16357 tempest-VolumesGetTest-1870624693 None] Created volume successfully.
Oct 29 21:21:23.897486 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-5795631c-c9f0-44ec-ab0c-fc7ce812e208 tempest-VolumesGetTest-1870624693 None] Acquiring lock "cinder-83fb3bc2-2c76-43e8-877b-41314e37c47c-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:21:23.920250 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-5795631c-c9f0-44ec-ab0c-fc7ce812e208 tempest-VolumesGetTest-1870624693 None] Lock "cinder-83fb3bc2-2c76-43e8-877b-41314e37c47c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:21:23.969181 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5795631c-c9f0-44ec-ab0c-fc7ce812e208 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:24.034923 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5795631c-c9f0-44ec-ab0c-fc7ce812e208 tempest-VolumesGetTest-1870624693 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:21:24.035364 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5795631c-c9f0-44ec-ab0c-fc7ce812e208 tempest-VolumesGetTest-1870624693 None] Volume volume-83fb3bc2-2c76-43e8-877b-41314e37c47c is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:21:24.039637 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5795631c-c9f0-44ec-ab0c-fc7ce812e208 tempest-VolumesGetTest-1870624693 None] deleting rbd volume volume-83fb3bc2-2c76-43e8-877b-41314e37c47c {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:21:24.249962 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda req-59a3beff-5a5b-4121-a604-65635ebe103a tempest-TestVolumeBootPattern-1121030847 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:21:24.410237 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-5795631c-c9f0-44ec-ab0c-fc7ce812e208 tempest-VolumesGetTest-1870624693 None] Created reservations ['8a8aa55a-d199-4b37-992b-f558d6d65edc', '4deac803-6397-498d-9f45-55abbba5e87b', '833bfe75-a315-4867-9dee-114a8e4b4ff2', 'a52fd8ea-b64d-4f45-8a3d-d9e96ffa819f'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:21:24.490968 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5795631c-c9f0-44ec-ab0c-fc7ce812e208 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:24.566475 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5795631c-c9f0-44ec-ab0c-fc7ce812e208 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:24.620408 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-5795631c-c9f0-44ec-ab0c-fc7ce812e208 tempest-VolumesGetTest-1870624693 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:21:24.625842 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-5795631c-c9f0-44ec-ab0c-fc7ce812e208 tempest-VolumesGetTest-1870624693 None] Deleted volume successfully.
Oct 29 21:21:24.644331 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-5795631c-c9f0-44ec-ab0c-fc7ce812e208 tempest-VolumesGetTest-1870624693 None] Lock "cinder-83fb3bc2-2c76-43e8-877b-41314e37c47c-delete_volume" released by "delete_volume" :: held 0.724s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:21:25.143493 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b58befe2-ef63-4739-9c7a-36c2bea2cad1 tempest-VolumesGetTest-1870624693 None] Acquiring lock "cinder-f092e226-2e3f-4fc8-9c27-2bae92ff0608-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:21:25.174232 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b58befe2-ef63-4739-9c7a-36c2bea2cad1 tempest-VolumesGetTest-1870624693 None] Lock "cinder-f092e226-2e3f-4fc8-9c27-2bae92ff0608-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:21:25.185169 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda req-59a3beff-5a5b-4121-a604-65635ebe103a tempest-TestVolumeBootPattern-1121030847 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.935s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:21:25.188500 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda req-59a3beff-5a5b-4121-a604-65635ebe103a tempest-TestVolumeBootPattern-1121030847 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1dd52dee-26a8-4479-b52c-88863fc657c0', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '1dd52dee-26a8-4479-b52c-88863fc657c0', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:21:25.200134 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=54,cinder:UPDATE=24,cinder:INSERT=20,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:21:25.238939 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=65,cinder:INSERT=10,cinder:UPDATE=22,cinder:DELETE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:21:25.324412 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda req-59a3beff-5a5b-4121-a604-65635ebe103a tempest-TestVolumeBootPattern-1121030847 None] Connection info returned from driver {'name': 'volumes/volume-1dd52dee-26a8-4479-b52c-88863fc657c0', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1dd52dee-26a8-4479-b52c-88863fc657c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f6cb6912-520e-4a51-b2ce-55ba86786df4'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:21:25.360379 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b58befe2-ef63-4739-9c7a-36c2bea2cad1 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:25.457182 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b58befe2-ef63-4739-9c7a-36c2bea2cad1 tempest-VolumesGetTest-1870624693 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:21:25.464269 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b58befe2-ef63-4739-9c7a-36c2bea2cad1 tempest-VolumesGetTest-1870624693 None] deleting rbd volume volume-f092e226-2e3f-4fc8-9c27-2bae92ff0608 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:21:25.560185 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-80594289-5a7c-4ca4-a77b-f9f9cf44dbda req-59a3beff-5a5b-4121-a604-65635ebe103a tempest-TestVolumeBootPattern-1121030847 None] attachment_update completed successfully.
Oct 29 21:21:25.720422 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b58befe2-ef63-4739-9c7a-36c2bea2cad1 tempest-VolumesGetTest-1870624693 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 21:21:25.766653 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b58befe2-ef63-4739-9c7a-36c2bea2cad1 tempest-VolumesGetTest-1870624693 None] deleting parent snapshot volume-f092e226-2e3f-4fc8-9c27-2bae92ff0608.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 21:21:26.005436 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-b58befe2-ef63-4739-9c7a-36c2bea2cad1 tempest-VolumesGetTest-1870624693 None] Created reservations ['f40c7660-06e9-44ac-a0bb-0c705b724fcd', '53ac1b51-446b-4719-ae56-98bdc46de1fe', 'fdffeaa1-e4b5-4e91-b202-a493d354bb3d', 'b6cd894a-f777-48d1-8274-4c0aba850641'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:21:26.070970 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b58befe2-ef63-4739-9c7a-36c2bea2cad1 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:26.118081 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b58befe2-ef63-4739-9c7a-36c2bea2cad1 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:26.172696 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-b58befe2-ef63-4739-9c7a-36c2bea2cad1 tempest-VolumesGetTest-1870624693 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:21:26.178319 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b58befe2-ef63-4739-9c7a-36c2bea2cad1 tempest-VolumesGetTest-1870624693 None] Deleted volume successfully.
Oct 29 21:21:26.194551 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b58befe2-ef63-4739-9c7a-36c2bea2cad1 tempest-VolumesGetTest-1870624693 None] Lock "cinder-f092e226-2e3f-4fc8-9c27-2bae92ff0608-delete_volume" released by "delete_volume" :: held 1.020s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:21:26.416911 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-09678e6c-37cb-4cbc-9b6e-e3ceb9bde015 tempest-VolumesGetTest-1870624693 None] Acquiring lock "cinder-ac6c000d-041f-4b07-ab5a-522354fed135-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:21:26.439214 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-09678e6c-37cb-4cbc-9b6e-e3ceb9bde015 tempest-VolumesGetTest-1870624693 None] Lock "cinder-ac6c000d-041f-4b07-ab5a-522354fed135-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:21:26.524822 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-09678e6c-37cb-4cbc-9b6e-e3ceb9bde015 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:26.608999 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-09678e6c-37cb-4cbc-9b6e-e3ceb9bde015 tempest-VolumesGetTest-1870624693 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:21:26.609483 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-09678e6c-37cb-4cbc-9b6e-e3ceb9bde015 tempest-VolumesGetTest-1870624693 None] Volume volume-ac6c000d-041f-4b07-ab5a-522354fed135 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:21:26.620242 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-09678e6c-37cb-4cbc-9b6e-e3ceb9bde015 tempest-VolumesGetTest-1870624693 None] deleting rbd volume volume-ac6c000d-041f-4b07-ab5a-522354fed135 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:21:26.864344 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-09678e6c-37cb-4cbc-9b6e-e3ceb9bde015 tempest-VolumesGetTest-1870624693 None] Created reservations ['2dc54d7b-e3ab-41cb-b411-d463f2b182a3', '79fa8877-b780-43ab-9216-c01010010021', '6be6db65-dacd-4edd-9915-6d7b5b8e6b44', '32dd0932-ab39-4c49-a310-d556f1f5196f'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:21:26.927627 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-09678e6c-37cb-4cbc-9b6e-e3ceb9bde015 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:26.981828 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-09678e6c-37cb-4cbc-9b6e-e3ceb9bde015 tempest-VolumesGetTest-1870624693 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:27.033147 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-09678e6c-37cb-4cbc-9b6e-e3ceb9bde015 tempest-VolumesGetTest-1870624693 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:21:27.037538 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-09678e6c-37cb-4cbc-9b6e-e3ceb9bde015 tempest-VolumesGetTest-1870624693 None] Deleted volume successfully.
Oct 29 21:21:27.051126 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-09678e6c-37cb-4cbc-9b6e-e3ceb9bde015 tempest-VolumesGetTest-1870624693 None] Lock "cinder-ac6c000d-041f-4b07-ab5a-522354fed135-delete_volume" released by "delete_volume" :: held 0.612s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:21:37.042831 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=21,cinder:INSERT=3,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:21:57.531917 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=20,cinder:SELECT=45,cinder:INSERT=5,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:21:57.533586 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a1841e39-abe4-4f38-b3ad-8303d4c39b1b tempest-GroupSnapshotsTest-1671049545 None] Group tempest-GroupSnapshotsTest-Group-1285232086: creating
Oct 29 21:21:57.575375 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a1841e39-abe4-4f38-b3ad-8303d4c39b1b tempest-GroupSnapshotsTest-1671049545 None] Group tempest-GroupSnapshotsTest-Group-1285232086: created successfully
Oct 29 21:21:57.586819 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a1841e39-abe4-4f38-b3ad-8303d4c39b1b tempest-GroupSnapshotsTest-1671049545 None] Create group completed successfully.
Oct 29 21:21:58.937627 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:21:58.952198 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Flow 'volume_create_manager' (5ee8dbbd-1a47-4576-ad41-f71f354148b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:58.958852 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d3f373-8263-4ee0-a3fa-cf82ceec6700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:58.976315 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d3f373-8263-4ee0-a3fa-cf82ceec6700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-316973460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=772dc0c2-8d00-49de-acde-ef8cf8bf949b,host='ncdv-master-1@ceph#ceph',id=738d6b22-421d-4828-a025-783100a8a53e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30438a9120e4aa5b87e1d4ad4b49454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:21:59Z,use_quota=True,user_id='9cb6074f3769463caf773b063d28d23f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58dda7aa-6594-4027-89b5-cd24b500457a),volume_type_id=58dda7aa-6594-4027-89b5-cd24b500457a)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:58.981706 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f9fc8a-4014-462a-a38b-1e57b8ad90f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:58.985905 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f9fc8a-4014-462a-a38b-1e57b8ad90f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:58.991096 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec4ad39-4f2a-4a75-b896-bb075646323e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:58.995197 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec4ad39-4f2a-4a75-b896-bb075646323e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738d6b22-421d-4828-a025-783100a8a53e', 'volume_name': 'volume-738d6b22-421d-4828-a025-783100a8a53e', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:59.000288 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49cf085-f409-4e24-be2c-a1282ffebf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:59.004094 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49cf085-f409-4e24-be2c-a1282ffebf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:59.008639 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac53e655-5c0f-45b8-b87e-3e12ed88bdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:59.009771 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Volume 738d6b22-421d-4828-a025-783100a8a53e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738d6b22-421d-4828-a025-783100a8a53e', 'volume_size': 1}
Oct 29 21:21:59.010174 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] creating volume 'volume-738d6b22-421d-4828-a025-783100a8a53e' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:21:59.010938 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:21:59.060163 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] extra_specs: {} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:21:59.060574 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] extra_specs: {} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:21:59.064265 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac53e655-5c0f-45b8-b87e-3e12ed88bdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738d6b22-421d-4828-a025-783100a8a53e', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:59.069208 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b6b229-f343-4fcc-b7e7-66c653c446e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:21:59.079647 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Volume volume-738d6b22-421d-4828-a025-783100a8a53e (738d6b22-421d-4828-a025-783100a8a53e): created successfully
Oct 29 21:21:59.083463 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b6b229-f343-4fcc-b7e7-66c653c446e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:21:59.088979 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Flow 'volume_create_manager' (5ee8dbbd-1a47-4576-ad41-f71f354148b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:21:59.099425 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-e0cba85e-7cb2-46e2-bb20-a9920923b00c tempest-GroupSnapshotsTest-1671049545 None] Created volume successfully.
Oct 29 21:22:00.186674 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-bf0b2989-075f-4f17-9663-f5b877a0a11e tempest-GroupSnapshotsTest-1671049545 None] GroupSnapshot 9b7832ff-06b8-4e1c-a5e9-5349d5a06ecf: creating.
Oct 29 21:22:00.213676 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-bf0b2989-075f-4f17-9663-f5b877a0a11e tempest-GroupSnapshotsTest-1671049545 None] Group snapshot 9b7832ff-06b8-4e1c-a5e9-5349d5a06ecf: creating. {{(pid=131780) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Oct 29 21:22:00.234396 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bf0b2989-075f-4f17-9663-f5b877a0a11e tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:01.013740 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-bf0b2989-075f-4f17-9663-f5b877a0a11e tempest-GroupSnapshotsTest-1671049545 None] group_snapshot 9b7832ff-06b8-4e1c-a5e9-5349d5a06ecf: created successfully
Oct 29 21:22:01.402921 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:22:01.403611 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:01.435397 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:01.478624 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:22:01.812408 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7debd285-388c-4645-998d-561f197a5adb tempest-GroupSnapshotsTest-1671049545 None] cloning volumes/volume-738d6b22-421d-4828-a025-783100a8a53e@snapshot-9a7c3b2a-f144-4215-8745-42bb5aff4c0f to volume-549e6d75-bb36-4c85-b5b2-b7ae60e63ba6 {{(pid=131780) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}}
Oct 29 21:22:01.813416 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7debd285-388c-4645-998d-561f197a5adb tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:01.862785 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7debd285-388c-4645-998d-561f197a5adb tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:01.981212 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7debd285-388c-4645-998d-561f197a5adb tempest-GroupSnapshotsTest-1671049545 None] extra_specs: {} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:22:01.981733 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7debd285-388c-4645-998d-561f197a5adb tempest-GroupSnapshotsTest-1671049545 None] extra_specs: {} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:22:02.043547 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7debd285-388c-4645-998d-561f197a5adb tempest-GroupSnapshotsTest-1671049545 None] Create group from source-snapshot-9b7832ff-06b8-4e1c-a5e9-5349d5a06ecf completed successfully.
Oct 29 21:22:03.365918 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a0fdbcd6-346f-4325-8e48-2ccb15f1d948 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:03.417243 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a0fdbcd6-346f-4325-8e48-2ccb15f1d948 tempest-GroupSnapshotsTest-1671049545 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:22:03.422211 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a0fdbcd6-346f-4325-8e48-2ccb15f1d948 tempest-GroupSnapshotsTest-1671049545 None] deleting rbd volume volume-549e6d75-bb36-4c85-b5b2-b7ae60e63ba6 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:22:03.589270 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-a0fdbcd6-346f-4325-8e48-2ccb15f1d948 tempest-GroupSnapshotsTest-1671049545 None] Created reservations ['8d7bb532-e757-4953-bfc3-4a2bd8fe396b'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:03.607208 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-a0fdbcd6-346f-4325-8e48-2ccb15f1d948 tempest-GroupSnapshotsTest-1671049545 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-406081931 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-406081931, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:22:03.608101 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-a0fdbcd6-346f-4325-8e48-2ccb15f1d948 tempest-GroupSnapshotsTest-1671049545 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-406081931 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-406081931, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:22:03.622592 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-a0fdbcd6-346f-4325-8e48-2ccb15f1d948 tempest-GroupSnapshotsTest-1671049545 None] Created reservations ['c7f0ab6d-63dd-4541-a3ea-8dfa04254645', 'bf9a15cd-870a-4611-961b-be4949e84da9', '51eb3360-97fe-4395-9807-c2cf0af9f6b8', 'f6cc3b79-6f8c-4dc5-8144-d66e6befbaca'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:03.702201 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a0fdbcd6-346f-4325-8e48-2ccb15f1d948 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:03.727279 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a0fdbcd6-346f-4325-8e48-2ccb15f1d948 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:03.755693 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-a0fdbcd6-346f-4325-8e48-2ccb15f1d948 tempest-GroupSnapshotsTest-1671049545 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:22:03.759904 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a0fdbcd6-346f-4325-8e48-2ccb15f1d948 tempest-GroupSnapshotsTest-1671049545 None] Delete group completed successfully.
Oct 29 21:22:04.513112 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-923bac2d-6d1a-4726-8ca6-f49d8cc36443 tempest-GroupSnapshotsTest-1671049545 None] group_snapshot 9b7832ff-06b8-4e1c-a5e9-5349d5a06ecf: deleting
Oct 29 21:22:04.529821 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-923bac2d-6d1a-4726-8ca6-f49d8cc36443 tempest-GroupSnapshotsTest-1671049545 None] group_snapshot 9b7832ff-06b8-4e1c-a5e9-5349d5a06ecf: deleting {{(pid=131780) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Oct 29 21:22:04.546180 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-923bac2d-6d1a-4726-8ca6-f49d8cc36443 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:05.023208 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-923bac2d-6d1a-4726-8ca6-f49d8cc36443 tempest-GroupSnapshotsTest-1671049545 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-406081931 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-406081931, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:22:05.038579 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-923bac2d-6d1a-4726-8ca6-f49d8cc36443 tempest-GroupSnapshotsTest-1671049545 None] Created reservations ['32711726-13bd-4443-b1ba-9f1f32e18c10', '90740096-bf18-4567-94de-87a6fe254bb7', '93093679-5714-467d-b0a1-d831b882a2f5', 'e2f3e565-c2e6-4a52-b99e-1de8f3d72178'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:05.053855 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=74,cinder:UPDATE=21,cinder:INSERT=5 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:22:05.091113 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-923bac2d-6d1a-4726-8ca6-f49d8cc36443 tempest-GroupSnapshotsTest-1671049545 None] group_snapshot 9b7832ff-06b8-4e1c-a5e9-5349d5a06ecf: deleted successfully
Oct 29 21:22:05.965700 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3180b9e8-ff38-47e7-9fe0-678b488c26be tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:06.021375 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3180b9e8-ff38-47e7-9fe0-678b488c26be tempest-GroupSnapshotsTest-1671049545 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:22:06.022822 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3180b9e8-ff38-47e7-9fe0-678b488c26be tempest-GroupSnapshotsTest-1671049545 None] Volume volume-738d6b22-421d-4828-a025-783100a8a53e is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:22:06.039758 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3180b9e8-ff38-47e7-9fe0-678b488c26be tempest-GroupSnapshotsTest-1671049545 None] deleting rbd volume volume-738d6b22-421d-4828-a025-783100a8a53e {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:22:06.250971 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-3180b9e8-ff38-47e7-9fe0-678b488c26be tempest-GroupSnapshotsTest-1671049545 None] Created reservations ['835b85b5-c1b1-49fc-8418-23023f1180b5'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:06.263918 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=71,cinder:UPDATE=24,cinder:DELETE=1,cinder:INSERT=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:22:06.285935 ncdv-master-1 cinder-volume[131780]: WARNING cinder.db.sqlalchemy.api [None req-3180b9e8-ff38-47e7-9fe0-678b488c26be tempest-GroupSnapshotsTest-1671049545 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-406081931']
Oct 29 21:22:06.289356 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-3180b9e8-ff38-47e7-9fe0-678b488c26be tempest-GroupSnapshotsTest-1671049545 None] Created reservations ['8628c5b1-c91c-494c-9f49-89c40deaa759', 'f3ed288d-d5c4-47c9-97a7-f3d82c57ac15', 'c4b2c526-b215-4a2c-87b9-7c0a55032350', '53b5d966-d391-4de2-aead-bb2e5c868012'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:06.371750 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3180b9e8-ff38-47e7-9fe0-678b488c26be tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:06.400811 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-3180b9e8-ff38-47e7-9fe0-678b488c26be tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:06.429189 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-3180b9e8-ff38-47e7-9fe0-678b488c26be tempest-GroupSnapshotsTest-1671049545 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:22:06.434062 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-3180b9e8-ff38-47e7-9fe0-678b488c26be tempest-GroupSnapshotsTest-1671049545 None] Delete group completed successfully.
Oct 29 21:22:07.340908 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-093bffd5-d9b2-49fd-a86c-a805fe3a5e23 tempest-GroupSnapshotsTest-1671049545 None] Group tempest-GroupSnapshotsTest-Group-739724021: creating
Oct 29 21:22:07.358709 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-093bffd5-d9b2-49fd-a86c-a805fe3a5e23 tempest-GroupSnapshotsTest-1671049545 None] Group tempest-GroupSnapshotsTest-Group-739724021: created successfully
Oct 29 21:22:07.368531 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-093bffd5-d9b2-49fd-a86c-a805fe3a5e23 tempest-GroupSnapshotsTest-1671049545 None] Create group completed successfully.
Oct 29 21:22:08.852318 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:22:08.870880 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Flow 'volume_create_manager' (02630b5c-7405-4286-8bdf-3085d2711ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:22:08.877065 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2f34ca-dd6b-468b-a1a2-45cb67cc8133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:08.893517 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2f34ca-dd6b-468b-a1a2-45cb67cc8133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1283092491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3869517f-6844-4bef-825d-db6f87bd011a,host='ncdv-master-1@ceph#ceph',id=af03eba3-bdd3-44fd-92ab-e8fe99178e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30438a9120e4aa5b87e1d4ad4b49454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:22:09Z,use_quota=True,user_id='9cb6074f3769463caf773b063d28d23f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15c0b101-2264-4627-8978-dd7df3fa46b0),volume_type_id=15c0b101-2264-4627-8978-dd7df3fa46b0)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:08.899260 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6fab33-1eca-40e7-b3ac-808ef8353b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:08.903234 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6fab33-1eca-40e7-b3ac-808ef8353b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:08.908108 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ba7407-6e97-4970-a8ed-06b6271e6195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:08.912150 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ba7407-6e97-4970-a8ed-06b6271e6195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af03eba3-bdd3-44fd-92ab-e8fe99178e5d', 'volume_name': 'volume-af03eba3-bdd3-44fd-92ab-e8fe99178e5d', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:08.916866 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9ac872-3703-4def-97e7-24a602f3128a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:08.920617 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9ac872-3703-4def-97e7-24a602f3128a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:08.925105 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e659af95-4a80-4838-873d-e88516548493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:08.926251 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Volume af03eba3-bdd3-44fd-92ab-e8fe99178e5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af03eba3-bdd3-44fd-92ab-e8fe99178e5d', 'volume_size': 1}
Oct 29 21:22:08.926649 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] creating volume 'volume-af03eba3-bdd3-44fd-92ab-e8fe99178e5d' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:22:08.927409 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:08.980665 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] extra_specs: {} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:22:08.980973 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] extra_specs: {} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:22:08.984876 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e659af95-4a80-4838-873d-e88516548493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af03eba3-bdd3-44fd-92ab-e8fe99178e5d', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:08.990962 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cdbe147-b2d6-4865-a8dd-dc5686484dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:09.000969 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Volume volume-af03eba3-bdd3-44fd-92ab-e8fe99178e5d (af03eba3-bdd3-44fd-92ab-e8fe99178e5d): created successfully
Oct 29 21:22:09.004645 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cdbe147-b2d6-4865-a8dd-dc5686484dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:09.010066 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Flow 'volume_create_manager' (02630b5c-7405-4286-8bdf-3085d2711ab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:22:09.017967 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-84622307-2b8a-4209-ac03-461470b0d695 tempest-GroupSnapshotsTest-1671049545 None] Created volume successfully.
Oct 29 21:22:10.305673 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:22:10.327187 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Flow 'volume_create_manager' (3a6f1f18-2020-410e-897b-b6d23aa61306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:22:10.334010 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9ab725-62de-4568-9b77-fd6f5aff67dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:10.354721 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9ab725-62de-4568-9b77-fd6f5aff67dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-527344557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3869517f-6844-4bef-825d-db6f87bd011a,host='ncdv-master-1@ceph#ceph',id=2ae3bef6-a19f-4cfa-a41e-4e4659f2a0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30438a9120e4aa5b87e1d4ad4b49454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:22:10Z,use_quota=True,user_id='9cb6074f3769463caf773b063d28d23f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15c0b101-2264-4627-8978-dd7df3fa46b0),volume_type_id=15c0b101-2264-4627-8978-dd7df3fa46b0)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:10.360249 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb62679-640c-4667-b4b2-54b486881761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:10.365321 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb62679-640c-4667-b4b2-54b486881761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:10.370808 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c5cf27-7c82-40bd-891b-835ec3f595a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:10.374901 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c5cf27-7c82-40bd-891b-835ec3f595a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae3bef6-a19f-4cfa-a41e-4e4659f2a0bb', 'volume_name': 'volume-2ae3bef6-a19f-4cfa-a41e-4e4659f2a0bb', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:10.380368 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe120bd8-d61a-4a87-b6b1-de52caeec5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:10.384393 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe120bd8-d61a-4a87-b6b1-de52caeec5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:10.389200 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96812dcb-4586-4b65-877d-21fbe73a2452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:10.390623 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Volume 2ae3bef6-a19f-4cfa-a41e-4e4659f2a0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae3bef6-a19f-4cfa-a41e-4e4659f2a0bb', 'volume_size': 1}
Oct 29 21:22:10.391087 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] creating volume 'volume-2ae3bef6-a19f-4cfa-a41e-4e4659f2a0bb' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:22:10.391823 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:10.440371 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] extra_specs: {} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:22:10.440780 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] extra_specs: {} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:22:10.445891 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96812dcb-4586-4b65-877d-21fbe73a2452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae3bef6-a19f-4cfa-a41e-4e4659f2a0bb', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:10.450711 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8104976-ee79-4add-8f00-2a3e8dbac92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:10.461991 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Volume volume-2ae3bef6-a19f-4cfa-a41e-4e4659f2a0bb (2ae3bef6-a19f-4cfa-a41e-4e4659f2a0bb): created successfully
Oct 29 21:22:10.466052 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8104976-ee79-4add-8f00-2a3e8dbac92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:10.471899 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Flow 'volume_create_manager' (3a6f1f18-2020-410e-897b-b6d23aa61306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:22:10.480474 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-eb29dfe9-c80e-48be-ad32-0f1088fcad68 tempest-GroupSnapshotsTest-1671049545 None] Created volume successfully.
Oct 29 21:22:11.501043 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-c66ce9d0-0524-4f9e-a3ee-a50b04187fa8 tempest-GroupSnapshotsTest-1671049545 None] Update group completed successfully.
Oct 29 21:22:12.646479 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-d0476192-ac28-4ac3-a40a-00fc4441358c tempest-GroupSnapshotsTest-1671049545 None] Update group completed successfully.
Oct 29 21:22:13.772664 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-9348b4d9-84f9-4e0c-a24b-527abfd0c0c5 tempest-GroupSnapshotsTest-1671049545 None] Update group completed successfully.
Oct 29 21:22:14.915293 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-ba0187fa-e4ef-4f58-ac16-2b98854f9dca tempest-GroupSnapshotsTest-1671049545 None] Update group completed successfully.
Oct 29 21:22:16.226291 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7934b5ed-2299-4a90-8433-ad259646390b tempest-GroupSnapshotsTest-1671049545 None] GroupSnapshot 8b00b06b-9a61-421a-86d4-00b205963db7: creating.
Oct 29 21:22:16.244410 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-7934b5ed-2299-4a90-8433-ad259646390b tempest-GroupSnapshotsTest-1671049545 None] Group snapshot 8b00b06b-9a61-421a-86d4-00b205963db7: creating. {{(pid=131780) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Oct 29 21:22:16.262753 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7934b5ed-2299-4a90-8433-ad259646390b tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:16.810855 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-7934b5ed-2299-4a90-8433-ad259646390b tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:17.883615 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-7934b5ed-2299-4a90-8433-ad259646390b tempest-GroupSnapshotsTest-1671049545 None] group_snapshot 8b00b06b-9a61-421a-86d4-00b205963db7: created successfully
Oct 29 21:22:18.482764 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4ee577c7-c69e-49da-bf90-4e522318f70b tempest-GroupSnapshotsTest-1671049545 None] group_snapshot 8b00b06b-9a61-421a-86d4-00b205963db7: deleting
Oct 29 21:22:18.501666 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4ee577c7-c69e-49da-bf90-4e522318f70b tempest-GroupSnapshotsTest-1671049545 None] group_snapshot 8b00b06b-9a61-421a-86d4-00b205963db7: deleting {{(pid=131780) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Oct 29 21:22:18.519243 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4ee577c7-c69e-49da-bf90-4e522318f70b tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:18.818291 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=22,cinder:SELECT=71,cinder:INSERT=5,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:22:18.829975 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4ee577c7-c69e-49da-bf90-4e522318f70b tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:19.898772 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-4ee577c7-c69e-49da-bf90-4e522318f70b tempest-GroupSnapshotsTest-1671049545 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1789259633 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1789259633, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:22:19.899612 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-4ee577c7-c69e-49da-bf90-4e522318f70b tempest-GroupSnapshotsTest-1671049545 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1789259633 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1789259633, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:22:19.914665 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-4ee577c7-c69e-49da-bf90-4e522318f70b tempest-GroupSnapshotsTest-1671049545 None] Created reservations ['be169644-0b09-4a0a-93f3-e8ace60ab4ca', '1a1f97b0-1b20-4fc3-812e-0fe302798f4a', '111a3327-bed5-462e-a791-1501a57c34d4', '06d1d20c-63b5-4fb5-a1b1-4e39291777a4'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:19.952410 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=28,cinder:SELECT=70,cinder:INSERT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:22:20.008174 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-4ee577c7-c69e-49da-bf90-4e522318f70b tempest-GroupSnapshotsTest-1671049545 None] Created reservations ['7673d70f-f524-41f7-b342-df9e78fa4d56', '1f697e06-5e4c-4189-bb77-76c31aeb5e61', '2f0aa75c-32a2-4a3c-b8c5-ccddf2610096', '384a5f61-0525-4b79-b850-0b405ce8b898'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:20.053473 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4ee577c7-c69e-49da-bf90-4e522318f70b tempest-GroupSnapshotsTest-1671049545 None] group_snapshot 8b00b06b-9a61-421a-86d4-00b205963db7: deleted successfully
Oct 29 21:22:21.121391 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:21.181015 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:22:21.181587 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] Volume volume-2ae3bef6-a19f-4cfa-a41e-4e4659f2a0bb is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:22:21.189924 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] deleting rbd volume volume-2ae3bef6-a19f-4cfa-a41e-4e4659f2a0bb {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:22:21.393523 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:21.441294 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:22:21.441837 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] Volume volume-af03eba3-bdd3-44fd-92ab-e8fe99178e5d is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:22:21.451208 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] deleting rbd volume volume-af03eba3-bdd3-44fd-92ab-e8fe99178e5d {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:22:21.715239 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] Created reservations ['768643e4-7dc5-4c39-aa15-128a1c4154b0'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:21.736753 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1789259633 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1789259633, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:22:21.753811 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] Created reservations ['47a3eab3-6f7a-46ae-8a44-3386a6d445fe', 'bee94c8d-e925-4852-9170-7ecf3e153b31', '1f989fa0-c4d4-4ef4-bfbf-02b7b28e443a', '754d0a02-6178-4393-bf2a-6a234d206757'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:21.848404 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] Created reservations ['4477ae22-bd31-4b2f-b105-d275901fbec1', 'c612d8cc-9107-481a-83d6-defa8214910d', 'fd85723b-da06-4c15-be9b-ce450016327d', '5c67c6d0-1c2a-40c8-b86f-32a7f7cee25c'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:21.969706 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:22.031407 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:22.090887 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:22:22.102410 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-83f659ec-7d03-4ee8-b5cd-63fd1b65b7c7 tempest-GroupSnapshotsTest-1671049545 None] Delete group completed successfully.
Oct 29 21:22:22.571039 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-15f516f5-2158-4158-9da6-dc745a1d6c66 tempest-GroupSnapshotsTest-1671049545 None] Group tempest-GroupSnapshotsTest-Group-675416941: creating
Oct 29 21:22:22.591235 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-15f516f5-2158-4158-9da6-dc745a1d6c66 tempest-GroupSnapshotsTest-1671049545 None] Group tempest-GroupSnapshotsTest-Group-675416941: created successfully
Oct 29 21:22:22.601973 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-15f516f5-2158-4158-9da6-dc745a1d6c66 tempest-GroupSnapshotsTest-1671049545 None] Create group completed successfully.
Oct 29 21:22:23.993965 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:22:24.014599 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Flow 'volume_create_manager' (90459f11-bb8a-4850-8b16-773c38f3a1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:22:24.021927 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9fb265-120b-46ef-89ec-57121e21f724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:24.039041 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9fb265-120b-46ef-89ec-57121e21f724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-466533901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7dcef8b0-a2de-4a5c-9589-8ba0bad5f0ef,host='ncdv-master-1@ceph#ceph',id=5e3eac12-e036-4110-88b3-d6ffe23f4518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c30438a9120e4aa5b87e1d4ad4b49454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:22:24Z,use_quota=True,user_id='9cb6074f3769463caf773b063d28d23f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(be01b846-99fb-4644-b2e8-70efd5298613),volume_type_id=be01b846-99fb-4644-b2e8-70efd5298613)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:24.044206 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2697a820-ed3a-44a0-ba29-ba48493e6acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:24.048199 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2697a820-ed3a-44a0-ba29-ba48493e6acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:24.053080 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48df81d4-8a03-410d-ba10-5d2767ff46d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:24.058075 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48df81d4-8a03-410d-ba10-5d2767ff46d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3eac12-e036-4110-88b3-d6ffe23f4518', 'volume_name': 'volume-5e3eac12-e036-4110-88b3-d6ffe23f4518', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:24.062706 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0551cb3f-9abc-45c1-b839-0181a4ac113c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:24.066516 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0551cb3f-9abc-45c1-b839-0181a4ac113c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:24.071052 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f0304e-fcc3-4e0c-9703-abe0723463f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:24.072150 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Volume 5e3eac12-e036-4110-88b3-d6ffe23f4518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3eac12-e036-4110-88b3-d6ffe23f4518', 'volume_size': 1}
Oct 29 21:22:24.072546 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] creating volume 'volume-5e3eac12-e036-4110-88b3-d6ffe23f4518' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:22:24.073273 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:24.126577 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] extra_specs: {} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:22:24.126880 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] extra_specs: {} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:22:24.131104 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f0304e-fcc3-4e0c-9703-abe0723463f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3eac12-e036-4110-88b3-d6ffe23f4518', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:24.135989 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab6beb8-9ba5-491d-8c19-430ba94dd1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:24.142270 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=54,cinder:UPDATE=36,cinder:INSERT=10 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:22:24.148743 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Volume volume-5e3eac12-e036-4110-88b3-d6ffe23f4518 (5e3eac12-e036-4110-88b3-d6ffe23f4518): created successfully
Oct 29 21:22:24.152408 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab6beb8-9ba5-491d-8c19-430ba94dd1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:24.157667 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Flow 'volume_create_manager' (90459f11-bb8a-4850-8b16-773c38f3a1f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:22:24.166742 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-341bcb58-50e4-4b4a-8c79-fe7e72bde906 tempest-GroupSnapshotsTest-1671049545 None] Created volume successfully.
Oct 29 21:22:25.208941 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-35128a8f-ea97-4986-a9a2-d76a7e027fb3 tempest-GroupSnapshotsTest-1671049545 None] GroupSnapshot d1b58c0d-1a05-42fe-8645-725cca24b48b: creating.
Oct 29 21:22:25.226772 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35128a8f-ea97-4986-a9a2-d76a7e027fb3 tempest-GroupSnapshotsTest-1671049545 None] Group snapshot d1b58c0d-1a05-42fe-8645-725cca24b48b: creating. {{(pid=131780) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Oct 29 21:22:25.244214 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-35128a8f-ea97-4986-a9a2-d76a7e027fb3 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:25.919047 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-35128a8f-ea97-4986-a9a2-d76a7e027fb3 tempest-GroupSnapshotsTest-1671049545 None] group_snapshot d1b58c0d-1a05-42fe-8645-725cca24b48b: created successfully
Oct 29 21:22:26.433442 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-095d3705-3625-4068-947d-acc0911fd839 tempest-GroupSnapshotsTest-1671049545 None] group_snapshot d1b58c0d-1a05-42fe-8645-725cca24b48b: deleting
Oct 29 21:22:26.450461 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-095d3705-3625-4068-947d-acc0911fd839 tempest-GroupSnapshotsTest-1671049545 None] group_snapshot d1b58c0d-1a05-42fe-8645-725cca24b48b: deleting {{(pid=131780) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Oct 29 21:22:26.468219 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-095d3705-3625-4068-947d-acc0911fd839 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:26.858235 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-095d3705-3625-4068-947d-acc0911fd839 tempest-GroupSnapshotsTest-1671049545 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-102635353 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-102635353, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:22:26.859029 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-095d3705-3625-4068-947d-acc0911fd839 tempest-GroupSnapshotsTest-1671049545 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-102635353 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-102635353, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:22:26.861226 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=65,cinder:INSERT=5,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:22:26.876520 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-095d3705-3625-4068-947d-acc0911fd839 tempest-GroupSnapshotsTest-1671049545 None] Created reservations ['e9016b8b-3299-4de4-8cc2-0404a64ac47b', '54f9bce1-c1ba-42da-a802-d0339239f853', 'bd09515f-563a-422a-a7c3-632278eae546', '4a44addf-8088-4a74-946d-0199f255ec71'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:26.921160 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-095d3705-3625-4068-947d-acc0911fd839 tempest-GroupSnapshotsTest-1671049545 None] group_snapshot d1b58c0d-1a05-42fe-8645-725cca24b48b: deleted successfully
Oct 29 21:22:27.875188 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9a5cbaf3-fbd4-43e4-8e6e-0584e51ef727 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:27.914175 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9a5cbaf3-fbd4-43e4-8e6e-0584e51ef727 tempest-GroupSnapshotsTest-1671049545 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:22:27.914611 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9a5cbaf3-fbd4-43e4-8e6e-0584e51ef727 tempest-GroupSnapshotsTest-1671049545 None] Volume volume-5e3eac12-e036-4110-88b3-d6ffe23f4518 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:22:27.918469 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9a5cbaf3-fbd4-43e4-8e6e-0584e51ef727 tempest-GroupSnapshotsTest-1671049545 None] deleting rbd volume volume-5e3eac12-e036-4110-88b3-d6ffe23f4518 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:22:28.103345 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-9a5cbaf3-fbd4-43e4-8e6e-0584e51ef727 tempest-GroupSnapshotsTest-1671049545 None] Created reservations ['7cc6ca2d-81cc-4da2-866f-23631b497d74'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:28.121508 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-9a5cbaf3-fbd4-43e4-8e6e-0584e51ef727 tempest-GroupSnapshotsTest-1671049545 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-102635353 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-102635353, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:22:28.135321 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-9a5cbaf3-fbd4-43e4-8e6e-0584e51ef727 tempest-GroupSnapshotsTest-1671049545 None] Created reservations ['77d2ef9d-63b7-49ea-9916-8da486781262', '057150ce-5292-4182-b857-36b52e031f40', '92897136-b643-4597-8c4b-afb16b153711', 'a80471cb-31c3-41a9-bfdb-dc6aed775f16'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:28.205103 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9a5cbaf3-fbd4-43e4-8e6e-0584e51ef727 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:28.229837 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-9a5cbaf3-fbd4-43e4-8e6e-0584e51ef727 tempest-GroupSnapshotsTest-1671049545 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:28.256074 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-9a5cbaf3-fbd4-43e4-8e6e-0584e51ef727 tempest-GroupSnapshotsTest-1671049545 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:22:28.260134 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-9a5cbaf3-fbd4-43e4-8e6e-0584e51ef727 tempest-GroupSnapshotsTest-1671049545 None] Delete group completed successfully.
Oct 29 21:22:36.086747 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:22:36.105227 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Flow 'volume_create_manager' (ac38d2b7-b032-4e72-b31d-d8564c8aa7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:22:36.111631 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b8c691-bcc8-4355-829b-ac934ca70958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:36.127567 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b8c691-bcc8-4355-829b-ac934ca70958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-500890226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cbb5e998-5913-4a1c-a5d0-9a557e0d0be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cacb270cfa6345c298bfe41be20045bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:22:36Z,use_quota=True,user_id='8d70475862904fe3a920de15b111ea94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76c96f0c-cf96-4356-a51e-9043db5e0953),volume_type_id=76c96f0c-cf96-4356-a51e-9043db5e0953)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:36.133296 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d36a0c-6b31-406e-88fe-88834584f8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:36.137302 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d36a0c-6b31-406e-88fe-88834584f8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:36.142217 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9873dc4-f263-4a22-9fad-e742ffacf76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:36.146282 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9873dc4-f263-4a22-9fad-e742ffacf76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb5e998-5913-4a1c-a5d0-9a557e0d0be7', 'volume_name': 'volume-cbb5e998-5913-4a1c-a5d0-9a557e0d0be7', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:36.151038 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37e2ecb-17e5-4efb-bf7c-510299214459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:36.154803 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37e2ecb-17e5-4efb-bf7c-510299214459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:36.159538 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a59b433-64c6-4f11-b2ec-4468fad54cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:36.160373 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Volume cbb5e998-5913-4a1c-a5d0-9a557e0d0be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb5e998-5913-4a1c-a5d0-9a557e0d0be7', 'volume_size': 1}
Oct 29 21:22:36.160804 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] creating volume 'volume-cbb5e998-5913-4a1c-a5d0-9a557e0d0be7' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:22:36.161527 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:36.221580 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] extra_specs: {} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:22:36.222089 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] extra_specs: {} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:22:36.226681 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a59b433-64c6-4f11-b2ec-4468fad54cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb5e998-5913-4a1c-a5d0-9a557e0d0be7', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:36.231392 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3c52ad-9efe-4328-8a87-95ca95ca2c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:36.242061 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Volume volume-cbb5e998-5913-4a1c-a5d0-9a557e0d0be7 (cbb5e998-5913-4a1c-a5d0-9a557e0d0be7): created successfully
Oct 29 21:22:36.245774 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3c52ad-9efe-4328-8a87-95ca95ca2c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:36.251251 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Flow 'volume_create_manager' (ac38d2b7-b032-4e72-b31d-d8564c8aa7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:22:36.259983 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b680bc30-0e4f-4c4b-9ade-f01bc1854d9e tempest-VolumeTypesAccessTest-1426447478 None] Created volume successfully.
Oct 29 21:22:37.463987 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-519b4fed-e08c-4ba8-9ef1-0a9017daf59a tempest-VolumeTypesAccessTest-1426447478 None] Acquiring lock "cinder-cbb5e998-5913-4a1c-a5d0-9a557e0d0be7-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:22:37.474869 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-519b4fed-e08c-4ba8-9ef1-0a9017daf59a tempest-VolumeTypesAccessTest-1426447478 None] Lock "cinder-cbb5e998-5913-4a1c-a5d0-9a557e0d0be7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:22:37.510813 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-519b4fed-e08c-4ba8-9ef1-0a9017daf59a tempest-VolumeTypesAccessTest-1426447478 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:37.553127 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-519b4fed-e08c-4ba8-9ef1-0a9017daf59a tempest-VolumeTypesAccessTest-1426447478 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:22:37.554265 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-519b4fed-e08c-4ba8-9ef1-0a9017daf59a tempest-VolumeTypesAccessTest-1426447478 None] Volume volume-cbb5e998-5913-4a1c-a5d0-9a557e0d0be7 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:22:37.559312 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-519b4fed-e08c-4ba8-9ef1-0a9017daf59a tempest-VolumeTypesAccessTest-1426447478 None] deleting rbd volume volume-cbb5e998-5913-4a1c-a5d0-9a557e0d0be7 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:22:37.709059 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-519b4fed-e08c-4ba8-9ef1-0a9017daf59a tempest-VolumeTypesAccessTest-1426447478 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1359185108 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1359185108, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:22:37.710466 ncdv-master-1 cinder-volume[131780]: WARNING cinder.quota [None req-519b4fed-e08c-4ba8-9ef1-0a9017daf59a tempest-VolumeTypesAccessTest-1426447478 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1359185108 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1359185108, it is now deprecated. Please use the default quota class for default quota.
Oct 29 21:22:37.727292 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-519b4fed-e08c-4ba8-9ef1-0a9017daf59a tempest-VolumeTypesAccessTest-1426447478 None] Created reservations ['315e81b4-eaaa-4756-b1e7-7aaf13847e72', 'b5577eed-ec49-462e-b5ae-b9ed9a166745', '994c0830-7cfc-40f3-a664-ea83627c57ca', '29eab65c-ea9d-44b5-8ffe-3f121b939421'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:37.762414 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=66,cinder:UPDATE=25,cinder:INSERT=9 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:22:37.776136 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-519b4fed-e08c-4ba8-9ef1-0a9017daf59a tempest-VolumeTypesAccessTest-1426447478 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:37.804208 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-519b4fed-e08c-4ba8-9ef1-0a9017daf59a tempest-VolumeTypesAccessTest-1426447478 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:37.830555 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-519b4fed-e08c-4ba8-9ef1-0a9017daf59a tempest-VolumeTypesAccessTest-1426447478 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:22:37.835499 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-519b4fed-e08c-4ba8-9ef1-0a9017daf59a tempest-VolumeTypesAccessTest-1426447478 None] Deleted volume successfully.
Oct 29 21:22:37.852789 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-519b4fed-e08c-4ba8-9ef1-0a9017daf59a tempest-VolumeTypesAccessTest-1426447478 None] Lock "cinder-cbb5e998-5913-4a1c-a5d0-9a557e0d0be7-delete_volume" released by "delete_volume" :: held 0.378s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:22:46.585362 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:22:46.604064 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Flow 'volume_create_manager' (e70d108f-f0c5-4a15-87cf-f57814b389d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:22:46.610124 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2d7eb6-6d8d-481f-89f6-af6b16877041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:46.625302 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2d7eb6-6d8d-481f-89f6-af6b16877041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1915634682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=be27555a-8d8b-46e4-88b4-a6e0a83d3e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e595bb456d45b8951f1420b0cd91ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:22:47Z,use_quota=True,user_id='f27f1e68de1d4b88b14769629c9cebbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:46.630456 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd25111-8fe8-4f83-ae32-11f4a663575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:46.634362 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbd25111-8fe8-4f83-ae32-11f4a663575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:46.639210 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2921ee5a-35c6-46e4-adfe-e699185fb342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:46.719587 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2921ee5a-35c6-46e4-adfe-e699185fb342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be27555a-8d8b-46e4-88b4-a6e0a83d3e31', 'volume_name': 'volume-be27555a-8d8b-46e4-88b4-a6e0a83d3e31', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93458830d0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:46.724403 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61463f97-b8fe-4a52-b3d5-d70be9090758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:46.728756 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61463f97-b8fe-4a52-b3d5-d70be9090758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:46.733308 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9609bdff-a58a-4fa4-b1da-c142426b4b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:46.734426 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Volume be27555a-8d8b-46e4-88b4-a6e0a83d3e31: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be27555a-8d8b-46e4-88b4-a6e0a83d3e31', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93458830d0>}
Oct 29 21:22:46.734981 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Cloning be27555a-8d8b-46e4-88b4-a6e0a83d3e31 from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 21:22:46.735712 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:22:46.743666 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:22:46.753713 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 22, 46, 748174)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:22:46.754156 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:22:46.754558 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Found cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 29 21:22:46.758740 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:22:46.759675 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 21:22:46.765444 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 22, 46, 763131)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:22:46.765921 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:22:46.766315 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Creating from source image-volume fbe0dd2e-351a-4779-844d-3c66baf14939 {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 29 21:22:46.778714 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:46.827492 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] creating snapshot='volume-be27555a-8d8b-46e4-88b4-a6e0a83d3e31.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 21:22:47.784877 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] cloning 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939@volume-be27555a-8d8b-46e4-88b4-a6e0a83d3e31.clone_snap' to 'volume-be27555a-8d8b-46e4-88b4-a6e0a83d3e31' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 21:22:47.910695 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:22:47.912170 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:22:47.913160 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:22:47.934966 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 21:22:47.935604 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Marking volume be27555a-8d8b-46e4-88b4-a6e0a83d3e31 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 21:22:47.944952 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to be27555a-8d8b-46e4-88b4-a6e0a83d3e31. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 21:22:47.945385 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Creating volume glance metadata for volume be27555a-8d8b-46e4-88b4-a6e0a83d3e31 backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 21:22:48.000526 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9609bdff-a58a-4fa4-b1da-c142426b4b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be27555a-8d8b-46e4-88b4-a6e0a83d3e31', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93458830d0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:48.004976 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6140144-754b-4190-8c8a-3af1f9f6c594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:48.013169 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Volume volume-be27555a-8d8b-46e4-88b4-a6e0a83d3e31 (be27555a-8d8b-46e4-88b4-a6e0a83d3e31): created successfully
Oct 29 21:22:48.016557 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6140144-754b-4190-8c8a-3af1f9f6c594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:48.021808 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Flow 'volume_create_manager' (e70d108f-f0c5-4a15-87cf-f57814b389d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:22:48.029272 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-c3cedd12-f411-4aa1-8a33-1d023dad343b tempest-VolumesImageMetadata-2123069853 None] Created volume successfully.
Oct 29 21:22:48.927079 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-afcd9f5b-2e7a-4f7a-b5ca-84290b44422e tempest-VolumesImageMetadata-2123069853 None] Acquiring lock "cinder-be27555a-8d8b-46e4-88b4-a6e0a83d3e31-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:22:48.937129 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-afcd9f5b-2e7a-4f7a-b5ca-84290b44422e tempest-VolumesImageMetadata-2123069853 None] Lock "cinder-be27555a-8d8b-46e4-88b4-a6e0a83d3e31-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:22:48.969484 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-afcd9f5b-2e7a-4f7a-b5ca-84290b44422e tempest-VolumesImageMetadata-2123069853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:49.030902 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-afcd9f5b-2e7a-4f7a-b5ca-84290b44422e tempest-VolumesImageMetadata-2123069853 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:22:49.037024 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-afcd9f5b-2e7a-4f7a-b5ca-84290b44422e tempest-VolumesImageMetadata-2123069853 None] deleting rbd volume volume-be27555a-8d8b-46e4-88b4-a6e0a83d3e31 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:22:49.156278 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-afcd9f5b-2e7a-4f7a-b5ca-84290b44422e tempest-VolumesImageMetadata-2123069853 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 21:22:49.186417 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-afcd9f5b-2e7a-4f7a-b5ca-84290b44422e tempest-VolumesImageMetadata-2123069853 None] deleting parent snapshot volume-be27555a-8d8b-46e4-88b4-a6e0a83d3e31.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 21:22:49.828348 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=60,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:22:49.841862 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-afcd9f5b-2e7a-4f7a-b5ca-84290b44422e tempest-VolumesImageMetadata-2123069853 None] Created reservations ['887394a8-7143-4697-b407-df6199f09714', 'e57af395-8926-4870-981f-24e35b853245', '88febafc-b084-459c-9e22-f1640a31d72e', 'd2188d6e-b278-4288-ac1e-21071db13904'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:49.887121 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-afcd9f5b-2e7a-4f7a-b5ca-84290b44422e tempest-VolumesImageMetadata-2123069853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:49.911059 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-afcd9f5b-2e7a-4f7a-b5ca-84290b44422e tempest-VolumesImageMetadata-2123069853 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:49.935552 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-afcd9f5b-2e7a-4f7a-b5ca-84290b44422e tempest-VolumesImageMetadata-2123069853 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:22:49.939795 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-afcd9f5b-2e7a-4f7a-b5ca-84290b44422e tempest-VolumesImageMetadata-2123069853 None] Deleted volume successfully.
Oct 29 21:22:49.952295 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-afcd9f5b-2e7a-4f7a-b5ca-84290b44422e tempest-VolumesImageMetadata-2123069853 None] Lock "cinder-be27555a-8d8b-46e4-88b4-a6e0a83d3e31-delete_volume" released by "delete_volume" :: held 1.015s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:22:51.687628 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:22:51.706642 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Flow 'volume_create_manager' (9adc291f-5dda-44fc-9a1c-a8a59d2f5a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:22:51.713576 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bb5a03-aa37-459e-a4e5-764b6a188b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:51.731193 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bb5a03-aa37-459e-a4e5-764b6a188b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1980968766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8181fe07-5115-4763-9df5-1b4e232b446e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3491f26943794655911bf7d790c4cca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:22:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:22:52Z,use_quota=True,user_id='0e627b41e33e48e491a698acce511067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:51.736305 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a305e9b-29d2-4673-b6a3-bb6fc1412d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:51.740297 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a305e9b-29d2-4673-b6a3-bb6fc1412d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:51.745300 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ebf0e8-c29d-4637-91e8-3cef622af7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:51.749262 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ebf0e8-c29d-4637-91e8-3cef622af7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8181fe07-5115-4763-9df5-1b4e232b446e', 'volume_name': 'volume-8181fe07-5115-4763-9df5-1b4e232b446e', 'volume_size': 2}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:51.754011 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0adb2bc8-c296-4194-a4b9-cf8406b0ec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:51.757804 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0adb2bc8-c296-4194-a4b9-cf8406b0ec1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:51.762880 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c12d799-6359-4ee2-bbd6-c7dbb0470dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:51.763934 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Volume 8181fe07-5115-4763-9df5-1b4e232b446e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8181fe07-5115-4763-9df5-1b4e232b446e', 'volume_size': 2}
Oct 29 21:22:51.764332 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] creating volume 'volume-8181fe07-5115-4763-9df5-1b4e232b446e' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:22:51.765094 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:51.813176 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:22:51.813588 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:22:51.817180 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c12d799-6359-4ee2-bbd6-c7dbb0470dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8181fe07-5115-4763-9df5-1b4e232b446e', 'volume_size': 2}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:51.821620 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbbc306-a51d-4952-8c92-1408fea8836f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:22:51.831223 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Volume volume-8181fe07-5115-4763-9df5-1b4e232b446e (8181fe07-5115-4763-9df5-1b4e232b446e): created successfully
Oct 29 21:22:51.834589 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbbc306-a51d-4952-8c92-1408fea8836f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:22:51.839792 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Flow 'volume_create_manager' (9adc291f-5dda-44fc-9a1c-a8a59d2f5a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:22:51.846976 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-c253d9c4-54ab-4d37-b608-93197ccb9b1c tempest-VolumesCloneNegativeTest-600889704 None] Created volume successfully.
Oct 29 21:22:52.818451 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-abaf4c43-ac9f-447d-861b-e79df4c387f6 tempest-VolumesCloneNegativeTest-600889704 None] Acquiring lock "cinder-8181fe07-5115-4763-9df5-1b4e232b446e-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:22:52.828408 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-abaf4c43-ac9f-447d-861b-e79df4c387f6 tempest-VolumesCloneNegativeTest-600889704 None] Lock "cinder-8181fe07-5115-4763-9df5-1b4e232b446e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:22:52.869697 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-abaf4c43-ac9f-447d-861b-e79df4c387f6 tempest-VolumesCloneNegativeTest-600889704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:52.900553 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-abaf4c43-ac9f-447d-861b-e79df4c387f6 tempest-VolumesCloneNegativeTest-600889704 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:22:52.900910 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-abaf4c43-ac9f-447d-861b-e79df4c387f6 tempest-VolumesCloneNegativeTest-600889704 None] Volume volume-8181fe07-5115-4763-9df5-1b4e232b446e is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:22:52.904720 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-abaf4c43-ac9f-447d-861b-e79df4c387f6 tempest-VolumesCloneNegativeTest-600889704 None] deleting rbd volume volume-8181fe07-5115-4763-9df5-1b4e232b446e {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:22:53.059419 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-abaf4c43-ac9f-447d-861b-e79df4c387f6 tempest-VolumesCloneNegativeTest-600889704 None] Created reservations ['2f35eb1e-1484-4d54-b72d-0b20169b5867', 'd7fa5008-e96d-4cbf-96ed-bb6d9b2bda89', '6eba81be-04ef-4421-8342-29f18978a3a3', '3cb94b37-a2e6-420f-8af0-9627632069f2'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:22:53.101522 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-abaf4c43-ac9f-447d-861b-e79df4c387f6 tempest-VolumesCloneNegativeTest-600889704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:53.125965 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-abaf4c43-ac9f-447d-861b-e79df4c387f6 tempest-VolumesCloneNegativeTest-600889704 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:22:53.148978 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-abaf4c43-ac9f-447d-861b-e79df4c387f6 tempest-VolumesCloneNegativeTest-600889704 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:22:53.153048 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-abaf4c43-ac9f-447d-861b-e79df4c387f6 tempest-VolumesCloneNegativeTest-600889704 None] Deleted volume successfully.
Oct 29 21:22:53.166140 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-abaf4c43-ac9f-447d-861b-e79df4c387f6 tempest-VolumesCloneNegativeTest-600889704 None] Lock "cinder-8181fe07-5115-4763-9df5-1b4e232b446e-delete_volume" released by "delete_volume" :: held 0.337s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:23:01.404676 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:23:01.405370 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:23:01.458245 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:23:01.522355 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:23:04.114210 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=51,cinder:UPDATE=25,cinder:INSERT=15,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:23:24.139635 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=18,cinder:SELECT=26,cinder:DELETE=2,cinder:INSERT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:23:48.459418 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:23:48.463796 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-d1fc78b4-9b28-4ef1-9568-a5ebc401f321 req-6e38a69f-b66a-4fea-a1b2-a36a405ea52f tempest-TestVolumeBootPattern-1121030847 None] Terminate volume connection completed successfully.
Oct 29 21:23:48.464702 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-d1fc78b4-9b28-4ef1-9568-a5ebc401f321 req-6e38a69f-b66a-4fea-a1b2-a36a405ea52f tempest-TestVolumeBootPattern-1121030847 None] Deleting attachment f6cb6912-520e-4a51-b2ce-55ba86786df4. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:23:52.134749 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 req-2dde65f1-1ce6-42b3-92ee-0819b85abcba tempest-TestVolumeBootPattern-1121030847 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:23:52.994758 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 req-2dde65f1-1ce6-42b3-92ee-0819b85abcba tempest-TestVolumeBootPattern-1121030847 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.860s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:23:52.996018 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 req-2dde65f1-1ce6-42b3-92ee-0819b85abcba tempest-TestVolumeBootPattern-1121030847 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1dd52dee-26a8-4479-b52c-88863fc657c0', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '1dd52dee-26a8-4479-b52c-88863fc657c0', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:23:53.032547 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 req-2dde65f1-1ce6-42b3-92ee-0819b85abcba tempest-TestVolumeBootPattern-1121030847 None] Connection info returned from driver {'name': 'volumes/volume-1dd52dee-26a8-4479-b52c-88863fc657c0', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1dd52dee-26a8-4479-b52c-88863fc657c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e312bc98-402e-4bf7-8287-4e17c0bc106d'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:23:53.105388 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-3b1fd141-0e9e-41f0-a4f2-2c569c8866c3 req-2dde65f1-1ce6-42b3-92ee-0819b85abcba tempest-TestVolumeBootPattern-1121030847 None] attachment_update completed successfully.
Oct 29 21:24:01.408933 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:24:01.409977 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:24:01.438575 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:24:01.478389 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:24:04.131537 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=13,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:24:24.138811 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:24:24.140523 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=21,cinder:UPDATE=5 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:24:44.142530 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:24:54.153201 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:25:01.413946 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:25:01.414593 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:25:01.437909 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:25:01.462962 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:25:14.151254 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:25:34.152078 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:25:44.158173 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:25:52.334123 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-46724d32-6ea7-42a7-b71e-e230fa008129 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:25:53.117049 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-46724d32-6ea7-42a7-b71e-e230fa008129 tempest-TestVolumeBootPattern-1121030847 None] Create snapshot completed successfully
Oct 29 21:25:53.750440 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:25:53.778808 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Flow 'volume_create_manager' (d6dbee57-41de-4416-a502-877e38eb3944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:25:53.785064 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8803ef-7d29-42ee-a164-dfa5a9ff27d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:25:53.800958 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8803ef-7d29-42ee-a164-dfa5a9ff27d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-1808885560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4b580ab1-99d9-4c83-995d-602d8d953016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1eca42e66ec4ad1b747ef6027e894df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a0cd6f8b-c043-4ec1-9076-80b030ccd257,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:25:54Z,use_quota=True,user_id='1254ce210eae494b8c2bfc925b9978c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:25:53.806048 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7b0507-c6ce-4a63-b689-67fb64eaff0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:25:53.810258 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7b0507-c6ce-4a63-b689-67fb64eaff0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:25:53.815688 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf2050f-91fd-4dd4-85ac-47d037011948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:25:53.819541 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf2050f-91fd-4dd4-85ac-47d037011948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4b580ab1-99d9-4c83-995d-602d8d953016', 'volume_name': 'volume-4b580ab1-99d9-4c83-995d-602d8d953016', 'volume_size': 1, 'snapshot_id': 'a0cd6f8b-c043-4ec1-9076-80b030ccd257'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:25:53.824191 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5990f2d3-93bc-4535-9365-4c10bcda02f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:25:53.827934 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5990f2d3-93bc-4535-9365-4c10bcda02f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:25:53.833000 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca9ff87-b3ae-4271-bdf7-d479f0140914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:25:53.834064 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Volume 4b580ab1-99d9-4c83-995d-602d8d953016: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4b580ab1-99d9-4c83-995d-602d8d953016', 'volume_size': 1, 'snapshot_id': 'a0cd6f8b-c043-4ec1-9076-80b030ccd257'}
Oct 29 21:25:53.856002 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] cloning volumes/volume-1dd52dee-26a8-4479-b52c-88863fc657c0@snapshot-a0cd6f8b-c043-4ec1-9076-80b030ccd257 to volume-4b580ab1-99d9-4c83-995d-602d8d953016 {{(pid=131780) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1184}}
Oct 29 21:25:53.856628 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:25:53.914996 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:25:54.019235 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:25:54.019566 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:25:54.041611 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Marking volume 4b580ab1-99d9-4c83-995d-602d8d953016 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 21:25:54.046161 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Copying metadata from snapshot a0cd6f8b-c043-4ec1-9076-80b030ccd257 to 4b580ab1-99d9-4c83-995d-602d8d953016. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}}
Oct 29 21:25:54.076544 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca9ff87-b3ae-4271-bdf7-d479f0140914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b580ab1-99d9-4c83-995d-602d8d953016', 'volume_size': 1, 'snapshot_id': 'a0cd6f8b-c043-4ec1-9076-80b030ccd257'}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:25:54.081513 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53eab26a-4727-4ada-970f-e1eac9aabfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:25:54.089671 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Volume volume-4b580ab1-99d9-4c83-995d-602d8d953016 (4b580ab1-99d9-4c83-995d-602d8d953016): created successfully
Oct 29 21:25:54.093054 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53eab26a-4727-4ada-970f-e1eac9aabfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:25:54.100894 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Flow 'volume_create_manager' (d6dbee57-41de-4416-a502-877e38eb3944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:25:54.114643 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-17be54ba-27b7-4a9d-86c5-e3160ce2a3a0 tempest-TestVolumeBootPattern-1121030847 None] Created volume successfully.
Oct 29 21:25:57.327432 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 req-d909bdaa-e247-4d61-bd12-41a89d0300b9 tempest-TestVolumeBootPattern-1121030847 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:25:58.068088 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 req-d909bdaa-e247-4d61-bd12-41a89d0300b9 tempest-TestVolumeBootPattern-1121030847 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.740s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:25:58.068904 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 req-d909bdaa-e247-4d61-bd12-41a89d0300b9 tempest-TestVolumeBootPattern-1121030847 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4b580ab1-99d9-4c83-995d-602d8d953016', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '4b580ab1-99d9-4c83-995d-602d8d953016', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:25:58.094022 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 req-d909bdaa-e247-4d61-bd12-41a89d0300b9 tempest-TestVolumeBootPattern-1121030847 None] Connection info returned from driver {'name': 'volumes/volume-4b580ab1-99d9-4c83-995d-602d8d953016', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4b580ab1-99d9-4c83-995d-602d8d953016', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a123e8d5-94e8-4a43-bcab-d6fe036cdea5'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:25:58.144527 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-52fda1ac-4f3e-4fb0-98c3-6ff0184422d6 req-d909bdaa-e247-4d61-bd12-41a89d0300b9 tempest-TestVolumeBootPattern-1121030847 None] attachment_update completed successfully.
Oct 29 21:26:01.417867 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:26:01.418788 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:26:01.444919 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:26:01.467892 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:26:04.162889 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=33,cinder:UPDATE=7,cinder:INSERT=13,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:26:14.169643 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=37,cinder:INSERT=11,cinder:DELETE=1,cinder:UPDATE=5 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:26:34.172412 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:26:44.177504 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:27:01.423658 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:27:01.424336 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:27:01.452064 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:27:01.478891 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:27:04.179786 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:27:24.183239 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:27:24.185020 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:27:54.196974 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:27:54.198761 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:28:01.347163 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-5cfc5292-7e7f-4830-82f4-19ab7476399d req-545b64c1-b7d9-4ffc-bfb5-7061938d3fd8 tempest-TestVolumeBootPattern-1121030847 None] Terminate volume connection completed successfully.
Oct 29 21:28:01.348577 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-5cfc5292-7e7f-4830-82f4-19ab7476399d req-545b64c1-b7d9-4ffc-bfb5-7061938d3fd8 tempest-TestVolumeBootPattern-1121030847 None] Deleting attachment a123e8d5-94e8-4a43-bcab-d6fe036cdea5. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:28:01.424302 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:28:01.425087 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:28:01.478932 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:28:01.511213 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:28:02.574455 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-bd898e39-8509-424d-a010-1751406c3e8d tempest-TestVolumeBootPattern-1121030847 None] Acquiring lock "cinder-4b580ab1-99d9-4c83-995d-602d8d953016-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:28:02.583987 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-bd898e39-8509-424d-a010-1751406c3e8d tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-4b580ab1-99d9-4c83-995d-602d8d953016-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:28:02.618567 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bd898e39-8509-424d-a010-1751406c3e8d tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:28:02.696129 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bd898e39-8509-424d-a010-1751406c3e8d tempest-TestVolumeBootPattern-1121030847 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:28:02.703490 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bd898e39-8509-424d-a010-1751406c3e8d tempest-TestVolumeBootPattern-1121030847 None] deleting rbd volume volume-4b580ab1-99d9-4c83-995d-602d8d953016 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:28:02.983114 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-bd898e39-8509-424d-a010-1751406c3e8d tempest-TestVolumeBootPattern-1121030847 None] Created reservations ['cf673ea6-c036-4bab-b847-ce8d4cdc35f2', 'b2e49f1d-233b-4e6a-b931-ca13bca3bbce', 'd69f064a-eb55-40ad-ac0b-efcced8c7db0', 'bbc6519d-a909-4622-a085-4a2ccfa8cede'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:28:03.031049 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bd898e39-8509-424d-a010-1751406c3e8d tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:28:03.057432 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-bd898e39-8509-424d-a010-1751406c3e8d tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:28:03.085815 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-bd898e39-8509-424d-a010-1751406c3e8d tempest-TestVolumeBootPattern-1121030847 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:28:03.091270 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-bd898e39-8509-424d-a010-1751406c3e8d tempest-TestVolumeBootPattern-1121030847 None] Deleted volume successfully.
Oct 29 21:28:03.118551 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-bd898e39-8509-424d-a010-1751406c3e8d tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-4b580ab1-99d9-4c83-995d-602d8d953016-delete_volume" released by "delete_volume" :: held 0.535s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:28:03.712002 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b2318c32-0aa7-4f0e-ac25-a4b1529c3fad tempest-TestVolumeBootPattern-1121030847 None] Acquiring lock "cinder-a0cd6f8b-c043-4ec1-9076-80b030ccd257-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:28:03.721136 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b2318c32-0aa7-4f0e-ac25-a4b1529c3fad tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-a0cd6f8b-c043-4ec1-9076-80b030ccd257-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:28:03.723068 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-b2318c32-0aa7-4f0e-ac25-a4b1529c3fad tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:28:14.200050 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=18,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:28:24.216666 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=17,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:28:33.879900 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-b2318c32-0aa7-4f0e-ac25-a4b1529c3fad tempest-TestVolumeBootPattern-1121030847 None] Created reservations ['185ac825-cfd6-4cfc-ac36-9029b61c3d4b', '6dcbfe9d-67c9-4360-996e-56526f29a9f5', '03b712a5-cadf-48f2-813a-3f64c9149c43', 'd6dae067-b545-4f0d-a18b-733163d8489b'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:28:33.917067 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-b2318c32-0aa7-4f0e-ac25-a4b1529c3fad tempest-TestVolumeBootPattern-1121030847 None] Delete snapshot completed successfully.
Oct 29 21:28:33.922276 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-b2318c32-0aa7-4f0e-ac25-a4b1529c3fad tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-a0cd6f8b-c043-4ec1-9076-80b030ccd257-delete_snapshot" released by "delete_snapshot" :: held 30.201s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:28:38.336306 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-a4c8f399-684f-473e-8b41-884ebf8def7e req-b2c06754-7568-4448-a876-7f24cfcaca5b tempest-TestVolumeBootPattern-1121030847 None] Terminate volume connection completed successfully.
Oct 29 21:28:38.336990 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-a4c8f399-684f-473e-8b41-884ebf8def7e req-b2c06754-7568-4448-a876-7f24cfcaca5b tempest-TestVolumeBootPattern-1121030847 None] Deleting attachment e312bc98-402e-4bf7-8287-4e17c0bc106d. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:28:40.213060 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-68bdb509-ff1a-4718-aca5-119c48265009 tempest-TestVolumeBootPattern-1121030847 None] Acquiring lock "cinder-1dd52dee-26a8-4479-b52c-88863fc657c0-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:28:40.222653 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-68bdb509-ff1a-4718-aca5-119c48265009 tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-1dd52dee-26a8-4479-b52c-88863fc657c0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:28:40.255636 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-68bdb509-ff1a-4718-aca5-119c48265009 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:28:40.316382 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-68bdb509-ff1a-4718-aca5-119c48265009 tempest-TestVolumeBootPattern-1121030847 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:28:40.322626 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-68bdb509-ff1a-4718-aca5-119c48265009 tempest-TestVolumeBootPattern-1121030847 None] deleting rbd volume volume-1dd52dee-26a8-4479-b52c-88863fc657c0 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:28:40.510435 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-68bdb509-ff1a-4718-aca5-119c48265009 tempest-TestVolumeBootPattern-1121030847 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 21:28:40.537675 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-68bdb509-ff1a-4718-aca5-119c48265009 tempest-TestVolumeBootPattern-1121030847 None] deleting parent snapshot volume-1dd52dee-26a8-4479-b52c-88863fc657c0.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 21:28:41.143485 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-68bdb509-ff1a-4718-aca5-119c48265009 tempest-TestVolumeBootPattern-1121030847 None] Created reservations ['470d8330-926d-4cbf-9096-654dc189a8b7', 'dee2f9d8-bb82-409a-a342-01a73312aded', '29df5823-d7ef-42c8-87d0-327fc417a2a3', '01ed0f88-373b-4570-962c-f67e54de6fad'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:28:41.186845 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-68bdb509-ff1a-4718-aca5-119c48265009 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:28:41.214828 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-68bdb509-ff1a-4718-aca5-119c48265009 tempest-TestVolumeBootPattern-1121030847 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:28:41.240044 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-68bdb509-ff1a-4718-aca5-119c48265009 tempest-TestVolumeBootPattern-1121030847 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:28:41.247708 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-68bdb509-ff1a-4718-aca5-119c48265009 tempest-TestVolumeBootPattern-1121030847 None] Deleted volume successfully.
Oct 29 21:28:41.259818 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-68bdb509-ff1a-4718-aca5-119c48265009 tempest-TestVolumeBootPattern-1121030847 None] Lock "cinder-1dd52dee-26a8-4479-b52c-88863fc657c0-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:28:54.204854 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=30,cinder:UPDATE=14,cinder:INSERT=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:29:01.422993 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:29:01.423666 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:29:01.446826 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:29:01.470915 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:29:04.211472 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=29,cinder:INSERT=4,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:29:24.218464 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:29:34.224254 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:29:54.231992 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:30:01.426308 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:30:01.426961 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:30:01.451189 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:30:01.475349 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:30:14.240896 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:30:24.246196 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:30:44.255679 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:30:54.258805 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:31:14.267837 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:31:24.276357 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:31:44.272002 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:32:01.431517 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:32:01.432230 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:32:01.463202 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:32:01.488950 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:32:04.280353 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:32:20.076490 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:32:20.089832 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:32:20.109510 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Flow 'volume_create_manager' (5070c7fc-b5df-4119-af0a-a4e35ab9da51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:32:20.115711 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6449f4a2-55a6-4883-b6d4-bdaf7647c96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:32:20.131354 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6449f4a2-55a6-4883-b6d4-bdaf7647c96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-95477978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c91e01df-10ad-4e2e-b562-8cb63cd3bb87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c3945de287465586005125fb5cdc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:32:20Z,use_quota=True,user_id='1a26316480cd41b8b1469ced129540a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:32:20.136631 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a20e7dd-0349-4dd4-8034-a09a7c0b1ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:32:20.141198 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a20e7dd-0349-4dd4-8034-a09a7c0b1ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:32:20.146203 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8865217-b51e-4665-9a9b-c780c3ce4732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:32:20.241179 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8865217-b51e-4665-9a9b-c780c3ce4732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c91e01df-10ad-4e2e-b562-8cb63cd3bb87', 'volume_name': 'volume-c91e01df-10ad-4e2e-b562-8cb63cd3bb87', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9346657eb0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:32:20.246064 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5ce822-5b6a-4c03-a5dd-a1bc301ce0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:32:20.249987 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5ce822-5b6a-4c03-a5dd-a1bc301ce0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:32:20.254757 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e478f68-47e4-40a1-a847-21e7f0673729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:32:20.255887 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Volume c91e01df-10ad-4e2e-b562-8cb63cd3bb87: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c91e01df-10ad-4e2e-b562-8cb63cd3bb87', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9346657eb0>}
Oct 29 21:32:20.256467 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Cloning c91e01df-10ad-4e2e-b562-8cb63cd3bb87 from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 21:32:20.257222 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:32:20.266685 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:32:20.276549 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 32, 20, 271298)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:32:20.276984 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:32:20.277382 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Found cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 29 21:32:20.282008 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:32:20.282922 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 21:32:20.288501 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 21, 32, 20, 286245)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 21:32:20.288938 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 21:32:20.289329 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Creating from source image-volume fbe0dd2e-351a-4779-844d-3c66baf14939 {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 29 21:32:20.301058 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:32:20.349191 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] creating snapshot='volume-c91e01df-10ad-4e2e-b562-8cb63cd3bb87.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 21:32:21.377423 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] cloning 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939@volume-c91e01df-10ad-4e2e-b562-8cb63cd3bb87.clone_snap' to 'volume-c91e01df-10ad-4e2e-b562-8cb63cd3bb87' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 21:32:21.490560 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:32:21.491736 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:32:21.492183 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:32:21.510783 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 21:32:21.511637 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Marking volume c91e01df-10ad-4e2e-b562-8cb63cd3bb87 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 21:32:21.521080 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to c91e01df-10ad-4e2e-b562-8cb63cd3bb87. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 21:32:21.521567 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Creating volume glance metadata for volume c91e01df-10ad-4e2e-b562-8cb63cd3bb87 backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 21:32:21.583906 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e478f68-47e4-40a1-a847-21e7f0673729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91e01df-10ad-4e2e-b562-8cb63cd3bb87', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9346657eb0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:32:21.588847 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a9268c-b610-4ae3-a9d4-770b56712094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:32:21.599641 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Volume volume-c91e01df-10ad-4e2e-b562-8cb63cd3bb87 (c91e01df-10ad-4e2e-b562-8cb63cd3bb87): created successfully
Oct 29 21:32:21.603665 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a9268c-b610-4ae3-a9d4-770b56712094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:32:21.609058 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Flow 'volume_create_manager' (5070c7fc-b5df-4119-af0a-a4e35ab9da51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:32:21.616842 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-975418f7-6113-4a73-8474-284ce33d67b5 tempest-TestVolumeBackupRestore-663968730 None] Created volume successfully.
Oct 29 21:32:22.477996 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f2c15bba-b101-4126-a9b0-e942cfdb8b47 tempest-TestVolumeBackupRestore-663968730 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-10-29T21:32:22Z,data_timestamp=2022-10-29T21:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=5df9e169-ef67-4fb8-8117-12e30033aca5,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='95c3945de287465586005125fb5cdc6f',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='1a26316480cd41b8b1469ced129540a9',volume_id=c91e01df-10ad-4e2e-b562-8cb63cd3bb87)
Oct 29 21:32:22.478746 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.backup.rpcapi [None req-f2c15bba-b101-4126-a9b0-e942cfdb8b47 tempest-TestVolumeBackupRestore-663968730 None] continue_backup in rpcapi backup_id 5df9e169-ef67-4fb8-8117-12e30033aca5 {{(pid=131780) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Oct 29 21:32:22.574106 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-f2c15bba-b101-4126-a9b0-e942cfdb8b47 tempest-TestVolumeBackupRestore-663968730 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:32:23.330622 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-f2c15bba-b101-4126-a9b0-e942cfdb8b47 tempest-TestVolumeBackupRestore-663968730 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.756s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:32:23.331775 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f2c15bba-b101-4126-a9b0-e942cfdb8b47 tempest-TestVolumeBackupRestore-663968730 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c91e01df-10ad-4e2e-b562-8cb63cd3bb87', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'c91e01df-10ad-4e2e-b562-8cb63cd3bb87', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:32:23.348667 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f2c15bba-b101-4126-a9b0-e942cfdb8b47 tempest-TestVolumeBackupRestore-663968730 None] Initialize volume connection completed successfully.
Oct 29 21:32:28.412798 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f2c15bba-b101-4126-a9b0-e942cfdb8b47 tempest-TestVolumeBackupRestore-663968730 None] Terminate volume connection completed successfully.
Oct 29 21:32:28.429797 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f2c15bba-b101-4126-a9b0-e942cfdb8b47 tempest-TestVolumeBackupRestore-663968730 None] Remove volume export completed successfully.
Oct 29 21:32:28.986521 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:32:29.008142 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Flow 'volume_create_manager' (3feccbf0-4e71-4ea9-8862-441f2a404c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:32:29.014463 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1691196f-bb3e-4d84-9cdd-a934065bdd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:32:29.029963 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1691196f-bb3e-4d84-9cdd-a934065bdd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:32:29Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_5df9e169-ef67-4fb8-8117-12e30033aca5',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3fbf07a3-4a30-47a6-9015-204ce7f9490c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95c3945de287465586005125fb5cdc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:32:29Z,use_quota=True,user_id='1a26316480cd41b8b1469ced129540a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:32:29.035093 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9070528e-c560-4569-8509-77d676a446da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:32:29.039089 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9070528e-c560-4569-8509-77d676a446da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:32:29.044624 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2201c43-744f-4116-8368-2e8b3b3e96c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:32:29.048571 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2201c43-744f-4116-8368-2e8b3b3e96c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fbf07a3-4a30-47a6-9015-204ce7f9490c', 'volume_name': 'volume-3fbf07a3-4a30-47a6-9015-204ce7f9490c', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:32:29.053294 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624fce54-b4d5-4139-899d-6a1694e9a6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:32:29.057194 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624fce54-b4d5-4139-899d-6a1694e9a6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:32:29.062381 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c134ee-4d84-433f-ae2b-4df014f25ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:32:29.063432 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Volume 3fbf07a3-4a30-47a6-9015-204ce7f9490c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fbf07a3-4a30-47a6-9015-204ce7f9490c', 'volume_size': 1}
Oct 29 21:32:29.063842 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] creating volume 'volume-3fbf07a3-4a30-47a6-9015-204ce7f9490c' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:32:29.064941 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:32:29.113709 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:32:29.114093 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:32:29.117656 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c134ee-4d84-433f-ae2b-4df014f25ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fbf07a3-4a30-47a6-9015-204ce7f9490c', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:32:29.122638 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a78cc7f-ba22-406c-86d8-38472c28c68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:32:29.131847 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Volume volume-3fbf07a3-4a30-47a6-9015-204ce7f9490c (3fbf07a3-4a30-47a6-9015-204ce7f9490c): created successfully
Oct 29 21:32:29.135555 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a78cc7f-ba22-406c-86d8-38472c28c68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:32:29.140734 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Flow 'volume_create_manager' (3feccbf0-4e71-4ea9-8862-441f2a404c8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:32:29.148391 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Created volume successfully.
Oct 29 21:32:30.019638 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:32:30.770396 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.750s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:32:30.771212 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3fbf07a3-4a30-47a6-9015-204ce7f9490c', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '3fbf07a3-4a30-47a6-9015-204ce7f9490c', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:32:30.788452 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Initialize volume connection completed successfully.
Oct 29 21:32:34.640806 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Terminate volume connection completed successfully.
Oct 29 21:32:34.648392 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=33,cinder:UPDATE=9,cinder:INSERT=6,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:32:34.658833 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4bc73f36-1995-4b16-beed-a542a1728032 tempest-TestVolumeBackupRestore-663968730 None] Remove volume export completed successfully.
Oct 29 21:32:39.405533 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-aeb48bc2-af12-49c9-931d-4193f68693d7 req-062e86e8-afb7-49ed-be1c-126a08e9a952 tempest-TestVolumeBackupRestore-663968730 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:32:40.623995 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-aeb48bc2-af12-49c9-931d-4193f68693d7 req-062e86e8-afb7-49ed-be1c-126a08e9a952 tempest-TestVolumeBackupRestore-663968730 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.218s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:32:40.625630 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-aeb48bc2-af12-49c9-931d-4193f68693d7 req-062e86e8-afb7-49ed-be1c-126a08e9a952 tempest-TestVolumeBackupRestore-663968730 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3fbf07a3-4a30-47a6-9015-204ce7f9490c', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '3fbf07a3-4a30-47a6-9015-204ce7f9490c', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:32:40.651696 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-aeb48bc2-af12-49c9-931d-4193f68693d7 req-062e86e8-afb7-49ed-be1c-126a08e9a952 tempest-TestVolumeBackupRestore-663968730 None] Connection info returned from driver {'name': 'volumes/volume-3fbf07a3-4a30-47a6-9015-204ce7f9490c', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3fbf07a3-4a30-47a6-9015-204ce7f9490c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fe0920a2-8ac0-4f8a-9035-92b7acaa86b2'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:32:40.724143 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-aeb48bc2-af12-49c9-931d-4193f68693d7 req-062e86e8-afb7-49ed-be1c-126a08e9a952 tempest-TestVolumeBackupRestore-663968730 None] attachment_update completed successfully.
Oct 29 21:32:54.284541 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=43,cinder:UPDATE=5,cinder:INSERT=6,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:33:01.434331 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:33:01.435435 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:33:01.462427 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:33:01.486678 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:33:14.284967 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=17,cinder:UPDATE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:33:24.293349 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:33:37.851938 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-d5cfaa30-e69b-41a2-9f00-0d379a769b21 req-0750c952-37e5-459f-b915-e0692267e40d tempest-TestVolumeBackupRestore-663968730 None] Terminate volume connection completed successfully.
Oct 29 21:33:37.852662 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-d5cfaa30-e69b-41a2-9f00-0d379a769b21 req-0750c952-37e5-459f-b915-e0692267e40d tempest-TestVolumeBackupRestore-663968730 None] Deleting attachment fe0920a2-8ac0-4f8a-9035-92b7acaa86b2. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:33:39.453040 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a51fa9df-0b8a-450c-bac5-7cbc06e55d33 tempest-TestVolumeBackupRestore-663968730 None] Acquiring lock "cinder-3fbf07a3-4a30-47a6-9015-204ce7f9490c-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:33:39.464086 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a51fa9df-0b8a-450c-bac5-7cbc06e55d33 tempest-TestVolumeBackupRestore-663968730 None] Lock "cinder-3fbf07a3-4a30-47a6-9015-204ce7f9490c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:33:39.501180 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a51fa9df-0b8a-450c-bac5-7cbc06e55d33 tempest-TestVolumeBackupRestore-663968730 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:33:40.429557 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a51fa9df-0b8a-450c-bac5-7cbc06e55d33 tempest-TestVolumeBackupRestore-663968730 None] Volume volume-3fbf07a3-4a30-47a6-9015-204ce7f9490c is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:33:40.441493 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a51fa9df-0b8a-450c-bac5-7cbc06e55d33 tempest-TestVolumeBackupRestore-663968730 None] deleting rbd volume volume-3fbf07a3-4a30-47a6-9015-204ce7f9490c {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:33:40.446785 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-028ef047-2db8-4793-a04b-57e29bbbd220 tempest-TestVolumeBackupRestore-663968730 None] Acquiring lock "cinder-c91e01df-10ad-4e2e-b562-8cb63cd3bb87-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:33:40.455584 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-028ef047-2db8-4793-a04b-57e29bbbd220 tempest-TestVolumeBackupRestore-663968730 None] Lock "cinder-c91e01df-10ad-4e2e-b562-8cb63cd3bb87-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:33:40.490931 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-028ef047-2db8-4793-a04b-57e29bbbd220 tempest-TestVolumeBackupRestore-663968730 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:33:41.455959 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-028ef047-2db8-4793-a04b-57e29bbbd220 tempest-TestVolumeBackupRestore-663968730 None] deleting rbd volume volume-c91e01df-10ad-4e2e-b562-8cb63cd3bb87 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:33:41.496190 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-a51fa9df-0b8a-450c-bac5-7cbc06e55d33 tempest-TestVolumeBackupRestore-663968730 None] Created reservations ['f35a442c-4d46-4676-bfc2-4ad2fc908b50', '3064af98-d14f-4e91-a551-c8b727115aa6', '18c1e064-04ea-432b-b932-d74793c78c14', 'cde1633b-7279-422e-b59d-dd82348df593'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:33:41.542680 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a51fa9df-0b8a-450c-bac5-7cbc06e55d33 tempest-TestVolumeBackupRestore-663968730 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:33:41.569614 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-a51fa9df-0b8a-450c-bac5-7cbc06e55d33 tempest-TestVolumeBackupRestore-663968730 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:33:41.597165 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-a51fa9df-0b8a-450c-bac5-7cbc06e55d33 tempest-TestVolumeBackupRestore-663968730 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:33:41.602140 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-a51fa9df-0b8a-450c-bac5-7cbc06e55d33 tempest-TestVolumeBackupRestore-663968730 None] Deleted volume successfully.
Oct 29 21:33:41.608067 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-028ef047-2db8-4793-a04b-57e29bbbd220 tempest-TestVolumeBackupRestore-663968730 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 21:33:41.636114 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-028ef047-2db8-4793-a04b-57e29bbbd220 tempest-TestVolumeBackupRestore-663968730 None] deleting parent snapshot volume-c91e01df-10ad-4e2e-b562-8cb63cd3bb87.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 21:33:42.486583 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-a51fa9df-0b8a-450c-bac5-7cbc06e55d33 tempest-TestVolumeBackupRestore-663968730 None] Lock "cinder-3fbf07a3-4a30-47a6-9015-204ce7f9490c-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:33:42.513493 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-028ef047-2db8-4793-a04b-57e29bbbd220 tempest-TestVolumeBackupRestore-663968730 None] Created reservations ['33cbf3ba-860e-4ceb-9704-eb11800f5452', '65458a31-54c0-48c0-a936-c6c4495d7458', 'b1a0ef81-0087-4f5d-b23a-29fed1c8e9d5', '401e9457-de6a-4994-9b51-92fa2f33a8df'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:33:42.559977 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-028ef047-2db8-4793-a04b-57e29bbbd220 tempest-TestVolumeBackupRestore-663968730 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:33:42.584642 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-028ef047-2db8-4793-a04b-57e29bbbd220 tempest-TestVolumeBackupRestore-663968730 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:33:42.609732 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-028ef047-2db8-4793-a04b-57e29bbbd220 tempest-TestVolumeBackupRestore-663968730 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:33:42.613808 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-028ef047-2db8-4793-a04b-57e29bbbd220 tempest-TestVolumeBackupRestore-663968730 None] Deleted volume successfully.
Oct 29 21:33:42.626055 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-028ef047-2db8-4793-a04b-57e29bbbd220 tempest-TestVolumeBackupRestore-663968730 None] Lock "cinder-c91e01df-10ad-4e2e-b562-8cb63cd3bb87-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:33:44.295304 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=26,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:33:54.301302 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=37,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:34:01.432368 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:34:01.433033 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:34:01.464820 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:34:01.490536 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:34:04.304612 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:34:24.311219 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:34:34.315366 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:34:54.320600 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:35:01.435773 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:35:01.436433 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:35:01.468509 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:35:01.496722 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:35:04.323417 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:35:24.335738 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:35:34.339580 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:35:44.340404 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:36:01.432102 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:36:01.432753 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:36:01.456580 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:36:01.479839 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:36:14.347730 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:36:14.350218 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:36:34.350202 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:36:44.358318 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:37:01.435194 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:37:01.435852 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:37:01.459458 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:37:01.483033 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:37:04.362905 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:37:24.359078 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:37:44.356296 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:38:01.438386 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:38:01.439037 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:38:01.463140 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:38:01.486606 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:38:04.362165 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:38:04.362869 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:38:34.370831 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:38:44.369382 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:38:54.376425 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:39:01.441836 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:39:01.442502 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:39:01.466539 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:39:01.490631 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:39:04.378241 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:39:24.383906 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:39:34.387634 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:39:44.396011 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:40:01.445876 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:40:01.447043 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:40:01.470195 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:40:01.493479 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:40:04.398746 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:40:14.405601 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:40:44.409866 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=1,cinder:SELECT=5 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:40:44.416907 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:41:01.448606 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:41:01.449272 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:41:01.472902 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:41:01.495824 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:41:04.422928 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:41:14.422109 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=2,cinder:SELECT=6 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:41:24.431696 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:41:34.433518 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:41:44.439852 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:42:01.452038 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:42:01.453226 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:42:01.476062 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:42:01.499755 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:42:04.438505 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:42:04.443136 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:42:24.443782 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:42:34.450437 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:42:54.456956 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:43:01.456186 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:43:01.456880 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:43:01.479929 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:43:01.502324 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:43:04.461477 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:43:16.932858 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:43:16.952458 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Flow 'volume_create_manager' (f95b628b-91ba-4ed4-b4e9-ae3f4ad48b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:43:16.958745 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7c5c8d-a83c-46e4-ae26-1c93148bd8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:43:16.974659 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7c5c8d-a83c-46e4-ae26-1c93148bd8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1811448667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0026573f-81c4-40a0-9ab5-63da7bdac5f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e145894c36ae430fab13ece197e3eb8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:43:17Z,use_quota=True,user_id='c7ce87715e2c43cc987a8ed466f9e83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:43:16.979819 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391c7dac-c5f6-41b2-aa39-f0cf7cd50cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:43:16.983807 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391c7dac-c5f6-41b2-aa39-f0cf7cd50cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:43:16.989304 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11187792-d87e-43bd-a747-87c7e2c7f293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:43:16.993227 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11187792-d87e-43bd-a747-87c7e2c7f293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'volume_name': 'volume-0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:43:16.998020 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eefd7ad-a991-46f6-899a-e507e62824bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:43:17.001811 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eefd7ad-a991-46f6-899a-e507e62824bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:43:17.006427 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715080c2-675f-4eb2-8fc7-83d3041db08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:43:17.007430 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Volume 0026573f-81c4-40a0-9ab5-63da7bdac5f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'volume_size': 1}
Oct 29 21:43:17.007830 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] creating volume 'volume-0026573f-81c4-40a0-9ab5-63da7bdac5f3' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:43:17.008591 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:43:17.063262 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:43:17.063638 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:43:17.067356 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715080c2-675f-4eb2-8fc7-83d3041db08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:43:17.071783 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b183f366-9c52-4106-85c1-b3eb8d377455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:43:17.081712 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Volume volume-0026573f-81c4-40a0-9ab5-63da7bdac5f3 (0026573f-81c4-40a0-9ab5-63da7bdac5f3): created successfully
Oct 29 21:43:17.085135 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b183f366-9c52-4106-85c1-b3eb8d377455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:43:17.090439 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Flow 'volume_create_manager' (f95b628b-91ba-4ed4-b4e9-ae3f4ad48b1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:43:17.099435 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-df9cc1cb-afeb-4872-a31f-b66e23eb54f8 tempest-ServerActionsTestJSON-1032116884 None] Created volume successfully.
Oct 29 21:43:18.593980 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-ceee43e9-083e-481b-9f14-85ffff51518f req-74e5a152-a202-4034-bc9d-d4bdcf625e48 tempest-ServerActionsTestJSON-1032116884 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:43:19.345972 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-ceee43e9-083e-481b-9f14-85ffff51518f req-74e5a152-a202-4034-bc9d-d4bdcf625e48 tempest-ServerActionsTestJSON-1032116884 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.752s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:43:19.346803 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-ceee43e9-083e-481b-9f14-85ffff51518f req-74e5a152-a202-4034-bc9d-d4bdcf625e48 tempest-ServerActionsTestJSON-1032116884 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:43:19.370337 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-ceee43e9-083e-481b-9f14-85ffff51518f req-74e5a152-a202-4034-bc9d-d4bdcf625e48 tempest-ServerActionsTestJSON-1032116884 None] Connection info returned from driver {'name': 'volumes/volume-0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '57ade5b7-e562-4196-bdf5-0b28cf0901ed'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:43:19.417593 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-ceee43e9-083e-481b-9f14-85ffff51518f req-74e5a152-a202-4034-bc9d-d4bdcf625e48 tempest-ServerActionsTestJSON-1032116884 None] attachment_update completed successfully.
Oct 29 21:43:24.468175 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:43:41.534525 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=20,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:43:41.544526 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-6b8b007a-1709-4875-ad32-9ba84aee958d req-f32fcb48-fc13-41e3-816a-ce712dee1e39 tempest-ServerActionsTestJSON-1032116884 None] Terminate volume connection completed successfully.
Oct 29 21:43:41.544948 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-6b8b007a-1709-4875-ad32-9ba84aee958d req-f32fcb48-fc13-41e3-816a-ce712dee1e39 tempest-ServerActionsTestJSON-1032116884 None] Deleting attachment 57ade5b7-e562-4196-bdf5-0b28cf0901ed. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:43:43.876486 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-6b8b007a-1709-4875-ad32-9ba84aee958d req-85b06104-29dc-4e78-9d90-8f02bff35684 tempest-ServerActionsTestJSON-1032116884 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:43:44.612874 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-6b8b007a-1709-4875-ad32-9ba84aee958d req-85b06104-29dc-4e78-9d90-8f02bff35684 tempest-ServerActionsTestJSON-1032116884 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.736s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:43:44.613648 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-6b8b007a-1709-4875-ad32-9ba84aee958d req-85b06104-29dc-4e78-9d90-8f02bff35684 tempest-ServerActionsTestJSON-1032116884 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:43:44.634549 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-6b8b007a-1709-4875-ad32-9ba84aee958d req-85b06104-29dc-4e78-9d90-8f02bff35684 tempest-ServerActionsTestJSON-1032116884 None] Connection info returned from driver {'name': 'volumes/volume-0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e554ea54-8acc-438a-98f6-f44e531b73db'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:43:44.682601 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-6b8b007a-1709-4875-ad32-9ba84aee958d req-85b06104-29dc-4e78-9d90-8f02bff35684 tempest-ServerActionsTestJSON-1032116884 None] attachment_update completed successfully.
Oct 29 21:43:52.023068 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-595f5543-4a89-43ba-b3ed-f10baf4b8709 req-cff9eeee-48e6-4ab0-baa1-0aadb9c3ffae tempest-ServerActionsTestJSON-1032116884 None] Terminate volume connection completed successfully.
Oct 29 21:43:52.023752 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-595f5543-4a89-43ba-b3ed-f10baf4b8709 req-cff9eeee-48e6-4ab0-baa1-0aadb9c3ffae tempest-ServerActionsTestJSON-1032116884 None] Deleting attachment e554ea54-8acc-438a-98f6-f44e531b73db. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:43:54.305896 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-595f5543-4a89-43ba-b3ed-f10baf4b8709 req-3e2b66ec-c64e-49b1-8d13-b9ed4ae63c03 tempest-ServerActionsTestJSON-1032116884 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:43:55.041981 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-595f5543-4a89-43ba-b3ed-f10baf4b8709 req-3e2b66ec-c64e-49b1-8d13-b9ed4ae63c03 tempest-ServerActionsTestJSON-1032116884 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.736s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:43:55.042716 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-595f5543-4a89-43ba-b3ed-f10baf4b8709 req-3e2b66ec-c64e-49b1-8d13-b9ed4ae63c03 tempest-ServerActionsTestJSON-1032116884 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:43:55.044827 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=24,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:43:55.065922 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-595f5543-4a89-43ba-b3ed-f10baf4b8709 req-3e2b66ec-c64e-49b1-8d13-b9ed4ae63c03 tempest-ServerActionsTestJSON-1032116884 None] Connection info returned from driver {'name': 'volumes/volume-0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0026573f-81c4-40a0-9ab5-63da7bdac5f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '76a67af9-c9e6-47ca-8745-416877be156c'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:43:55.113850 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-595f5543-4a89-43ba-b3ed-f10baf4b8709 req-3e2b66ec-c64e-49b1-8d13-b9ed4ae63c03 tempest-ServerActionsTestJSON-1032116884 None] attachment_update completed successfully.
Oct 29 21:44:01.457322 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:44:01.458309 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:44:01.483455 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:44:01.507752 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:44:03.596384 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-1d68d787-b4d1-4d12-9084-9cb91cdf27f5 req-dffb7d14-d9cb-4a76-a740-a19151e10aa4 tempest-ServerActionsTestJSON-1032116884 None] Terminate volume connection completed successfully.
Oct 29 21:44:03.597049 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-1d68d787-b4d1-4d12-9084-9cb91cdf27f5 req-dffb7d14-d9cb-4a76-a740-a19151e10aa4 tempest-ServerActionsTestJSON-1032116884 None] Deleting attachment 76a67af9-c9e6-47ca-8745-416877be156c. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:44:04.398430 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-59a68568-caf3-4627-8818-f58ec124539b tempest-ServerActionsTestJSON-1032116884 None] Acquiring lock "cinder-0026573f-81c4-40a0-9ab5-63da7bdac5f3-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:44:04.411465 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-59a68568-caf3-4627-8818-f58ec124539b tempest-ServerActionsTestJSON-1032116884 None] Lock "cinder-0026573f-81c4-40a0-9ab5-63da7bdac5f3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:44:04.448582 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-59a68568-caf3-4627-8818-f58ec124539b tempest-ServerActionsTestJSON-1032116884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:44:04.490128 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-59a68568-caf3-4627-8818-f58ec124539b tempest-ServerActionsTestJSON-1032116884 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:44:04.490594 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-59a68568-caf3-4627-8818-f58ec124539b tempest-ServerActionsTestJSON-1032116884 None] Volume volume-0026573f-81c4-40a0-9ab5-63da7bdac5f3 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:44:04.495116 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-59a68568-caf3-4627-8818-f58ec124539b tempest-ServerActionsTestJSON-1032116884 None] deleting rbd volume volume-0026573f-81c4-40a0-9ab5-63da7bdac5f3 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:44:04.663776 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-59a68568-caf3-4627-8818-f58ec124539b tempest-ServerActionsTestJSON-1032116884 None] Created reservations ['1281c319-3591-4c80-a87b-7a740b973431', '304e8798-22ec-4c97-bbcb-b9e57eb60233', 'a742ccd8-8d42-42a5-8257-25aaa06fa726', 'f7f4ff13-5b84-4671-9f16-59b141c15dbe'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:44:04.707443 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-59a68568-caf3-4627-8818-f58ec124539b tempest-ServerActionsTestJSON-1032116884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:44:04.731818 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-59a68568-caf3-4627-8818-f58ec124539b tempest-ServerActionsTestJSON-1032116884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:44:04.756262 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-59a68568-caf3-4627-8818-f58ec124539b tempest-ServerActionsTestJSON-1032116884 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:44:04.761148 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-59a68568-caf3-4627-8818-f58ec124539b tempest-ServerActionsTestJSON-1032116884 None] Deleted volume successfully.
Oct 29 21:44:04.773946 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-59a68568-caf3-4627-8818-f58ec124539b tempest-ServerActionsTestJSON-1032116884 None] Lock "cinder-0026573f-81c4-40a0-9ab5-63da7bdac5f3-delete_volume" released by "delete_volume" :: held 0.363s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:44:14.506320 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=43,cinder:UPDATE=13,cinder:INSERT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:44:34.505192 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=27,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:44:44.513942 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:45:01.462835 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:45:01.463581 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:45:01.492240 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:45:01.517497 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:45:14.520181 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:45:14.528915 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:45:34.529324 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:45:49.864438 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:45:49.877854 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:45:49.897614 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Flow 'volume_create_manager' (0a2fc9d3-62b4-4640-9ad7-e38b27c3f7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:45:49.903854 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3495c9f-2f58-4e81-84d3-f1a510552608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:45:49.919034 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3495c9f-2f58-4e81-84d3-f1a510552608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-854229989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cda8ab19-025c-4b7b-a201-d5774ac83d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b20a3ad12b44529120efb74b4d8e8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:45:50Z,use_quota=True,user_id='fbe1b153b6874923a1b7640fbc793e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:45:49.924168 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c732bf-20f6-428e-9406-3daa9ecb4208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:45:49.928134 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97c732bf-20f6-428e-9406-3daa9ecb4208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:45:49.932992 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051c43e9-81e6-4dee-9303-4c1781fdd108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:45:49.936915 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051c43e9-81e6-4dee-9303-4c1781fdd108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cda8ab19-025c-4b7b-a201-d5774ac83d8a', 'volume_name': 'volume-cda8ab19-025c-4b7b-a201-d5774ac83d8a', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:45:49.942133 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea27e52a-f291-4bf8-8d83-97061ddb95ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:45:49.945885 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea27e52a-f291-4bf8-8d83-97061ddb95ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:45:49.950375 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d17ba94-3b9e-4e96-b54f-7ea8fd345ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:45:49.951421 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Volume cda8ab19-025c-4b7b-a201-d5774ac83d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cda8ab19-025c-4b7b-a201-d5774ac83d8a', 'volume_size': 1}
Oct 29 21:45:49.951819 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] creating volume 'volume-cda8ab19-025c-4b7b-a201-d5774ac83d8a' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:45:49.952571 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:45:50.048311 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:45:50.048699 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:45:50.052334 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d17ba94-3b9e-4e96-b54f-7ea8fd345ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda8ab19-025c-4b7b-a201-d5774ac83d8a', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:45:50.056728 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6f1d02-cba3-4fba-a08e-041f17b8a0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:45:50.066133 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Volume volume-cda8ab19-025c-4b7b-a201-d5774ac83d8a (cda8ab19-025c-4b7b-a201-d5774ac83d8a): created successfully
Oct 29 21:45:50.069508 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6f1d02-cba3-4fba-a08e-041f17b8a0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:45:50.074765 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Flow 'volume_create_manager' (0a2fc9d3-62b4-4640-9ad7-e38b27c3f7e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:45:50.083291 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-4caf49f3-7eb2-4ad0-8bbd-78e60b9e639c tempest-TestMinimumBasicScenario-652419777 None] Created volume successfully.
Oct 29 21:45:51.524012 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-e142656e-cda7-405c-9147-1182e27589b9 req-b0639359-a304-42b2-aa1d-975831874602 tempest-TestMinimumBasicScenario-652419777 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:45:52.452005 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-e142656e-cda7-405c-9147-1182e27589b9 req-b0639359-a304-42b2-aa1d-975831874602 tempest-TestMinimumBasicScenario-652419777 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.928s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:45:52.452928 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-e142656e-cda7-405c-9147-1182e27589b9 req-b0639359-a304-42b2-aa1d-975831874602 tempest-TestMinimumBasicScenario-652419777 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cda8ab19-025c-4b7b-a201-d5774ac83d8a', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': 'cda8ab19-025c-4b7b-a201-d5774ac83d8a', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:45:52.478991 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-e142656e-cda7-405c-9147-1182e27589b9 req-b0639359-a304-42b2-aa1d-975831874602 tempest-TestMinimumBasicScenario-652419777 None] Connection info returned from driver {'name': 'volumes/volume-cda8ab19-025c-4b7b-a201-d5774ac83d8a', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cda8ab19-025c-4b7b-a201-d5774ac83d8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '61bbb13a-edeb-4c0f-a403-b4679aac0f2f'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:45:52.525079 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-e142656e-cda7-405c-9147-1182e27589b9 req-b0639359-a304-42b2-aa1d-975831874602 tempest-TestMinimumBasicScenario-652419777 None] attachment_update completed successfully.
Oct 29 21:45:54.824367 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-fd0c3878-d517-4ed6-a998-3d936af8caa0 tempest-TestMinimumBasicScenario-652419777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:45:55.901131 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-fd0c3878-d517-4ed6-a998-3d936af8caa0 tempest-TestMinimumBasicScenario-652419777 None] Create snapshot completed successfully
Oct 29 21:46:01.462965 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:46:01.463669 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:46:01.488811 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:46:01.512068 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:46:14.533325 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=21,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:46:14.534962 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=26,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:46:34.537056 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:46:54.542655 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:47:01.467310 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:47:01.467999 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:47:01.490987 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:47:01.514650 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:47:04.546024 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:47:24.553002 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:47:34.557436 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:47:54.564383 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:48:01.469264 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:48:01.469963 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:48:01.492886 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:48:01.517647 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:48:14.572470 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:48:22.240963 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f64de467-258d-40a4-9157-f8a5026d16a2 tempest-TestMinimumBasicScenario-652419777 None] Acquiring lock "cinder-db9ef1a4-2812-4119-8741-970636612897-delete_snapshot" by "delete_snapshot" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:48:22.250720 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f64de467-258d-40a4-9157-f8a5026d16a2 tempest-TestMinimumBasicScenario-652419777 None] Lock "cinder-db9ef1a4-2812-4119-8741-970636612897-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:48:22.252641 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-f64de467-258d-40a4-9157-f8a5026d16a2 tempest-TestMinimumBasicScenario-652419777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:48:34.569767 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:48:52.335596 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:48:52.375926 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-f64de467-258d-40a4-9157-f8a5026d16a2 tempest-TestMinimumBasicScenario-652419777 None] Created reservations ['8a7851fc-d7b9-44ba-b09b-12a215995229', '8e35a1fd-8ea2-4b4d-824e-5a2a2aea31ae', '87d6832d-49eb-4d28-b052-0813bb5052ab', '347040d5-2415-4607-88a7-8f443047dcf9'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:48:52.417510 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-f64de467-258d-40a4-9157-f8a5026d16a2 tempest-TestMinimumBasicScenario-652419777 None] Delete snapshot completed successfully.
Oct 29 21:48:52.421439 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-f64de467-258d-40a4-9157-f8a5026d16a2 tempest-TestMinimumBasicScenario-652419777 None] Lock "cinder-db9ef1a4-2812-4119-8741-970636612897-delete_snapshot" released by "delete_snapshot" :: held 30.171s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:49:01.472938 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:49:01.474762 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:49:01.514737 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:49:01.552808 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:49:04.587464 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:49:14.590560 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:49:34.595582 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:49:54.596406 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:50:01.477792 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:50:01.478460 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:50:01.504349 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:50:01.527906 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:50:04.606410 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:50:24.607516 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:50:33.849154 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-bc4429f6-2c4a-4ece-8434-5e6c32c2f7f2 req-7743d14a-635e-4621-97f4-952ebb613f1e tempest-TestMinimumBasicScenario-652419777 None] Terminate volume connection completed successfully.
Oct 29 21:50:33.849988 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-bc4429f6-2c4a-4ece-8434-5e6c32c2f7f2 req-7743d14a-635e-4621-97f4-952ebb613f1e tempest-TestMinimumBasicScenario-652419777 None] Deleting attachment 61bbb13a-edeb-4c0f-a403-b4679aac0f2f. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:50:34.403364 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-5dfd0248-caac-4b1b-8176-806ea58f0aeb tempest-TestMinimumBasicScenario-652419777 None] Acquiring lock "cinder-cda8ab19-025c-4b7b-a201-d5774ac83d8a-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:50:34.415901 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-5dfd0248-caac-4b1b-8176-806ea58f0aeb tempest-TestMinimumBasicScenario-652419777 None] Lock "cinder-cda8ab19-025c-4b7b-a201-d5774ac83d8a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:50:34.455105 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5dfd0248-caac-4b1b-8176-806ea58f0aeb tempest-TestMinimumBasicScenario-652419777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:50:34.495106 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5dfd0248-caac-4b1b-8176-806ea58f0aeb tempest-TestMinimumBasicScenario-652419777 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:50:34.496391 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5dfd0248-caac-4b1b-8176-806ea58f0aeb tempest-TestMinimumBasicScenario-652419777 None] Volume volume-cda8ab19-025c-4b7b-a201-d5774ac83d8a is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:50:34.500835 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5dfd0248-caac-4b1b-8176-806ea58f0aeb tempest-TestMinimumBasicScenario-652419777 None] deleting rbd volume volume-cda8ab19-025c-4b7b-a201-d5774ac83d8a {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:50:34.616402 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=12,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:50:34.660802 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-5dfd0248-caac-4b1b-8176-806ea58f0aeb tempest-TestMinimumBasicScenario-652419777 None] Created reservations ['4fe647a8-121d-4ae1-9c84-c2026770346e', 'a5d28b4c-52db-4f13-8cd9-4e862b574ddd', '1c89891b-f1c7-4104-9808-5e320d32c544', 'b3602300-c031-4816-a0b5-ed056bc7c115'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:50:34.704404 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5dfd0248-caac-4b1b-8176-806ea58f0aeb tempest-TestMinimumBasicScenario-652419777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:50:34.729633 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-5dfd0248-caac-4b1b-8176-806ea58f0aeb tempest-TestMinimumBasicScenario-652419777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:50:34.753687 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-5dfd0248-caac-4b1b-8176-806ea58f0aeb tempest-TestMinimumBasicScenario-652419777 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:50:34.757828 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-5dfd0248-caac-4b1b-8176-806ea58f0aeb tempest-TestMinimumBasicScenario-652419777 None] Deleted volume successfully.
Oct 29 21:50:34.769942 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-5dfd0248-caac-4b1b-8176-806ea58f0aeb tempest-TestMinimumBasicScenario-652419777 None] Lock "cinder-cda8ab19-025c-4b7b-a201-d5774ac83d8a-delete_volume" released by "delete_volume" :: held 0.354s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:50:44.763356 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=13,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:51:01.473630 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:51:01.474304 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:51:01.501718 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:51:01.528998 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:51:04.626871 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=16,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:51:07.680594 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 21:51:07.699592 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Flow 'volume_create_manager' (689322db-67c5-43a8-ac1f-845b512580d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:51:07.705826 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad9511f-8561-4426-9082-63a3d49ed235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:51:07.721598 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad9511f-8561-4426-9082-63a3d49ed235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T21:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-904008552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=12516987-791a-477f-8a6e-12c0fbeefd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b20a3ad12b44529120efb74b4d8e8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T21:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T21:51:08Z,use_quota=True,user_id='fbe1b153b6874923a1b7640fbc793e65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:51:07.727291 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fc4e3f-b713-46e0-960f-55390f6b4292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:51:07.731380 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fc4e3f-b713-46e0-960f-55390f6b4292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:51:07.736365 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33629c4f-b28e-48c8-a5b2-8a5b159dc356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:51:07.740942 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33629c4f-b28e-48c8-a5b2-8a5b159dc356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12516987-791a-477f-8a6e-12c0fbeefd32', 'volume_name': 'volume-12516987-791a-477f-8a6e-12c0fbeefd32', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:51:07.745700 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dadc5a5f-82bd-4b32-8339-6421dcaff07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:51:07.749431 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dadc5a5f-82bd-4b32-8339-6421dcaff07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:51:07.753953 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a983f9b-d666-468c-9ce7-f7ee6604eccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:51:07.755056 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Volume 12516987-791a-477f-8a6e-12c0fbeefd32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12516987-791a-477f-8a6e-12c0fbeefd32', 'volume_size': 1}
Oct 29 21:51:07.755455 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] creating volume 'volume-12516987-791a-477f-8a6e-12c0fbeefd32' {{(pid=131780) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1130}}
Oct 29 21:51:07.756212 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:51:07.802771 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 21:51:07.803277 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 21:51:07.806816 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a983f9b-d666-468c-9ce7-f7ee6604eccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12516987-791a-477f-8a6e-12c0fbeefd32', 'volume_size': 1}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:51:07.811167 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a68f09a-e676-4676-b373-9ea058240a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 21:51:07.820597 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Volume volume-12516987-791a-477f-8a6e-12c0fbeefd32 (12516987-791a-477f-8a6e-12c0fbeefd32): created successfully
Oct 29 21:51:07.824423 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a68f09a-e676-4676-b373-9ea058240a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 21:51:07.829598 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Flow 'volume_create_manager' (689322db-67c5-43a8-ac1f-845b512580d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 21:51:07.837405 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-35e6540c-67ee-4edf-9faa-bbe2f71eac48 tempest-TestMinimumBasicScenario-652419777 None] Created volume successfully.
Oct 29 21:51:09.354156 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-89df391b-36c3-43e4-a880-bc69ca6dfe71 req-9719377c-3c10-44cd-8ee0-575df44f09d6 tempest-TestMinimumBasicScenario-652419777 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 21:51:10.244109 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-89df391b-36c3-43e4-a880-bc69ca6dfe71 req-9719377c-3c10-44cd-8ee0-575df44f09d6 tempest-TestMinimumBasicScenario-652419777 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.890s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 21:51:10.244932 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-89df391b-36c3-43e4-a880-bc69ca6dfe71 req-9719377c-3c10-44cd-8ee0-575df44f09d6 tempest-TestMinimumBasicScenario-652419777 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-12516987-791a-477f-8a6e-12c0fbeefd32', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '12516987-791a-477f-8a6e-12c0fbeefd32', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 21:51:10.269618 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-89df391b-36c3-43e4-a880-bc69ca6dfe71 req-9719377c-3c10-44cd-8ee0-575df44f09d6 tempest-TestMinimumBasicScenario-652419777 None] Connection info returned from driver {'name': 'volumes/volume-12516987-791a-477f-8a6e-12c0fbeefd32', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '12516987-791a-477f-8a6e-12c0fbeefd32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b0548604-c378-4055-8a1f-2282edd260bd'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 21:51:10.316578 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-89df391b-36c3-43e4-a880-bc69ca6dfe71 req-9719377c-3c10-44cd-8ee0-575df44f09d6 tempest-TestMinimumBasicScenario-652419777 None] attachment_update completed successfully.
Oct 29 21:51:24.623847 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:51:34.628649 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=22,cinder:UPDATE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:51:44.633843 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:52:01.475802 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:52:01.476661 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:52:01.501964 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:52:01.526114 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:52:04.637033 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:52:14.646197 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:52:29.474901 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-9b939433-1aef-408e-8e44-dcaf1759af99 req-ac3af377-9c46-441e-b397-4f39552bef69 tempest-TestMinimumBasicScenario-652419777 None] Terminate volume connection completed successfully.
Oct 29 21:52:29.475456 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-9b939433-1aef-408e-8e44-dcaf1759af99 req-ac3af377-9c46-441e-b397-4f39552bef69 tempest-TestMinimumBasicScenario-652419777 None] Deleting attachment b0548604-c378-4055-8a1f-2282edd260bd. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 21:52:30.004683 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-331f2617-88c0-47a3-a07f-ae3dd0aab995 tempest-TestMinimumBasicScenario-652419777 None] Acquiring lock "cinder-12516987-791a-477f-8a6e-12c0fbeefd32-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 21:52:30.014546 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-331f2617-88c0-47a3-a07f-ae3dd0aab995 tempest-TestMinimumBasicScenario-652419777 None] Lock "cinder-12516987-791a-477f-8a6e-12c0fbeefd32-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 21:52:30.047404 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-331f2617-88c0-47a3-a07f-ae3dd0aab995 tempest-TestMinimumBasicScenario-652419777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:52:30.087733 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-331f2617-88c0-47a3-a07f-ae3dd0aab995 tempest-TestMinimumBasicScenario-652419777 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 21:52:30.088219 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-331f2617-88c0-47a3-a07f-ae3dd0aab995 tempest-TestMinimumBasicScenario-652419777 None] Volume volume-12516987-791a-477f-8a6e-12c0fbeefd32 is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 21:52:30.091972 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-331f2617-88c0-47a3-a07f-ae3dd0aab995 tempest-TestMinimumBasicScenario-652419777 None] deleting rbd volume volume-12516987-791a-477f-8a6e-12c0fbeefd32 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 21:52:30.266254 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [None req-331f2617-88c0-47a3-a07f-ae3dd0aab995 tempest-TestMinimumBasicScenario-652419777 None] Created reservations ['422a1d19-fada-4e50-ab99-4b82a91fbefc', 'c1ca867e-1996-4a0a-9a7f-d14798eacdbc', '13209008-a766-49b1-b628-2b43db5b6650', '75966165-8b17-4ba0-864e-13bcb9eb379f'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 21:52:30.309644 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-331f2617-88c0-47a3-a07f-ae3dd0aab995 tempest-TestMinimumBasicScenario-652419777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:52:30.333366 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-331f2617-88c0-47a3-a07f-ae3dd0aab995 tempest-TestMinimumBasicScenario-652419777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:52:30.357903 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-331f2617-88c0-47a3-a07f-ae3dd0aab995 tempest-TestMinimumBasicScenario-652419777 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:52:30.363162 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-331f2617-88c0-47a3-a07f-ae3dd0aab995 tempest-TestMinimumBasicScenario-652419777 None] Deleted volume successfully.
Oct 29 21:52:30.376492 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-331f2617-88c0-47a3-a07f-ae3dd0aab995 tempest-TestMinimumBasicScenario-652419777 None] Lock "cinder-12516987-791a-477f-8a6e-12c0fbeefd32-delete_volume" released by "delete_volume" :: held 0.362s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 21:52:34.653370 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=18,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:52:54.655553 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=19,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:53:01.471747 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:53:01.472398 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:53:01.503650 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:53:01.528742 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:53:14.657518 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:53:34.665465 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:53:44.670503 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:54:01.473799 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:54:01.474927 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:54:01.506062 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:54:01.534950 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:54:04.671924 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:54:14.666515 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:54:44.677147 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:54:44.677925 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:55:01.470232 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:55:01.470884 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:55:01.493938 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:55:01.520274 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:55:04.683061 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:55:14.691855 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:55:34.698537 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:55:54.699395 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:56:01.466228 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:56:01.466910 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:56:01.490466 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:56:01.514669 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:56:14.704259 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:56:34.706055 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:56:34.707110 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:57:01.470710 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:57:01.471845 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:57:01.495231 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:57:01.519768 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:57:04.716364 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:57:14.721568 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:57:24.729685 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:57:44.725596 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:58:01.474902 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:58:01.475563 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:58:01.499309 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:58:01.523154 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:58:04.731146 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:58:24.737645 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:58:24.738382 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:58:44.746280 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:58:54.755585 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:59:01.478689 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 21:59:01.479765 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:59:01.520882 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 21:59:01.565993 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 21:59:04.758207 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:59:24.754169 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:59:34.757548 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 21:59:54.766230 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:00:01.481744 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:00:01.482399 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:00:01.506199 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:00:01.530674 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:00:14.768253 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:00:34.771940 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:00:44.780991 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:00:54.786209 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:01:01.485869 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:01:01.486532 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:01:01.512571 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:01:01.541169 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:01:14.782345 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:01:34.786179 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:01:44.802493 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:02:01.486471 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:02:01.489322 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:02:01.564445 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:02:01.622174 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:02:04.798780 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:02:24.803713 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:02:24.806535 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:02:44.812077 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:02:54.819163 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:03:01.483679 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:03:01.484340 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:03:01.507992 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:03:01.531532 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:03:14.825884 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:03:14.828791 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:03:34.837083 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:03:54.845071 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:04:01.487502 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:04:01.488159 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:04:01.512376 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:04:01.535375 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:04:04.854211 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:04:24.854526 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:04:24.857420 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:04:34.866161 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:04:54.867742 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:05:01.491625 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:05:01.492297 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:05:01.523128 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:05:01.557937 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:05:14.876608 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:05:14.877235 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:05:34.877763 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:05:44.885324 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:06:01.493172 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:06:01.493916 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:06:01.518709 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:06:01.541965 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:06:04.887170 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:06:14.891084 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:06:34.896602 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:06:44.902437 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:06:55.776219 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=131780) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}}
Oct 29 22:06:55.796468 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Flow 'volume_create_manager' (dd3f7666-f1a9-4700-8a27-532677531daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 22:06:55.802688 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9270a2-ddb8-4fa1-b0c1-0ce3524d7224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 22:06:55.817803 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9270a2-ddb8-4fa1-b0c1-0ce3524d7224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-10-29T22:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1608426624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=10086bb1-c0f6-49c3-9b03-c394a4123d60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acb94fdfb41a44379268b11c328f7d03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-10-29T22:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-10-29T22:06:56Z,use_quota=True,user_id='a7d227b3e85c4c5ca5cdb36bf28a8ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(515a8a7b-db02-4220-a920-c2fe36d654f8),volume_type_id=515a8a7b-db02-4220-a920-c2fe36d654f8)' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 22:06:55.822927 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b25dfc1-8c51-4997-b261-82c94f83cfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 22:06:55.826859 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b25dfc1-8c51-4997-b261-82c94f83cfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 22:06:55.831696 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5d00de-ff23-4ba9-ad91-92217eb51363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 22:06:55.910439 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5d00de-ff23-4ba9-ad91-92217eb51363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10086bb1-c0f6-49c3-9b03-c394a4123d60', 'volume_name': 'volume-10086bb1-c0f6-49c3-9b03-c394a4123d60', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93468a24c0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 22:06:55.915297 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838e9d0e-543f-476b-9504-ce4dd075154f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 22:06:55.919701 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838e9d0e-543f-476b-9504-ce4dd075154f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 22:06:55.924145 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d43b1f-9007-4834-a8df-cc96cad691cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 22:06:55.925227 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Volume 10086bb1-c0f6-49c3-9b03-c394a4123d60: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10086bb1-c0f6-49c3-9b03-c394a4123d60', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93468a24c0>}
Oct 29 22:06:55.925818 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Cloning 10086bb1-c0f6-49c3-9b03-c394a4123d60 from image 1a2bec42-cf5e-436b-826e-51ea67e041f7  at location (None, None). {{(pid=131780) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}}
Oct 29 22:06:55.926547 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Acquiring lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" by "_prepare_image_cache_entry" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 22:06:55.934016 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 22:06:55.944171 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 22, 6, 55, 938933)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 22:06:55.944590 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 22:06:55.944983 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Found cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}}
Oct 29 22:06:55.948740 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Lock "cinder-1a2bec42-cf5e-436b-826e-51ea67e041f7" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 22:06:55.949660 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Attempting to retrieve cache entry for image = 1a2bec42-cf5e-436b-826e-51ea67e041f7 on host ncdv-master-1@ceph#ceph. {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}}
Oct 29 22:06:55.955034 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Found image-volume cache entry: {'id': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'volume_id': 'fbe0dd2e-351a-4779-844d-3c66baf14939', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55), 'last_used': datetime.datetime(2022, 10, 29, 22, 6, 55, 952870)}. {{(pid=131780) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Oct 29 22:06:55.955443 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.image.cache [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Image-volume cache entry image_update_at = 2022-10-29 20:37:55+00:00, requested image updated_at = 2022-10-29 20:37:55+00:00. {{(pid=131780) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Oct 29 22:06:55.955833 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Creating from source image-volume fbe0dd2e-351a-4779-844d-3c66baf14939 {{(pid=131780) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}}
Oct 29 22:06:55.967869 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:06:56.018611 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] creating snapshot='volume-10086bb1-c0f6-49c3-9b03-c394a4123d60.clone_snap' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:846}}
Oct 29 22:06:56.164996 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] cloning 'volume-fbe0dd2e-351a-4779-844d-3c66baf14939@volume-10086bb1-c0f6-49c3-9b03-c394a4123d60.clone_snap' to 'volume-10086bb1-c0f6-49c3-9b03-c394a4123d60' {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:852}}
Oct 29 22:06:56.288939 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Volume volume-2214e232-d1fe-4255-9dd8-84ea44b0fb7b.deleted is not a clone. {{(pid=131780) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1291}}
Oct 29 22:06:56.290178 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:982}}
Oct 29 22:06:56.290558 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=131780) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:991}}
Oct 29 22:06:56.304397 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] clone created successfully {{(pid=131780) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:925}}
Oct 29 22:06:56.305024 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.volume_utils [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Marking volume 10086bb1-c0f6-49c3-9b03-c394a4123d60 as bootable. {{(pid=131780) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Oct 29 22:06:56.312602 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Copying metadata from image 1a2bec42-cf5e-436b-826e-51ea67e041f7 to 10086bb1-c0f6-49c3-9b03-c394a4123d60. {{(pid=131780) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}}
Oct 29 22:06:56.313032 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.flows.manager.create_volume [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Creating volume glance metadata for volume 10086bb1-c0f6-49c3-9b03-c394a4123d60 backed by image 1a2bec42-cf5e-436b-826e-51ea67e041f7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=131780) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}}
Oct 29 22:06:56.364465 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d43b1f-9007-4834-a8df-cc96cad691cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10086bb1-c0f6-49c3-9b03-c394a4123d60', 'volume_size': 1, 'image_id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad2388a030f2411ea168c9f7f66bcfb0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '1a2bec42-cf5e-436b-826e-51ea67e041f7', 'created_at': datetime.datetime(2022, 10, 29, 20, 37, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 10, 29, 20, 37, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a2bec42-cf5e-436b-826e-51ea67e041f7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f93468a24c0>}' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 22:06:56.368920 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9146b3b2-76e8-4949-93cc-dabe42a748aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Oct 29 22:06:56.376425 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.flows.manager.create_volume [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Volume volume-10086bb1-c0f6-49c3-9b03-c394a4123d60 (10086bb1-c0f6-49c3-9b03-c394a4123d60): created successfully
Oct 29 22:06:56.379788 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9146b3b2-76e8-4949-93cc-dabe42a748aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=131780) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Oct 29 22:06:56.385094 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Flow 'volume_create_manager' (dd3f7666-f1a9-4700-8a27-532677531daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=131780) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Oct 29 22:06:56.393946 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [None req-209884c4-c4e9-4312-95d7-d5032f4a1dde tempest-TestShelveInstance-1712606706 None] Created volume successfully.
Oct 29 22:07:00.848258 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-4bf89a46-4c49-474f-bccd-1639db9c2e9d req-180486a8-b072-4499-bad2-2b4ceab0e22e tempest-TestShelveInstance-1712606706 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 22:07:01.496956 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:07:01.498900 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:07:01.547800 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:07:01.600124 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:07:01.607924 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-4bf89a46-4c49-474f-bccd-1639db9c2e9d req-180486a8-b072-4499-bad2-2b4ceab0e22e tempest-TestShelveInstance-1712606706 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.760s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 22:07:01.609002 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-4bf89a46-4c49-474f-bccd-1639db9c2e9d req-180486a8-b072-4499-bad2-2b4ceab0e22e tempest-TestShelveInstance-1712606706 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-10086bb1-c0f6-49c3-9b03-c394a4123d60', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '10086bb1-c0f6-49c3-9b03-c394a4123d60', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 22:07:01.635372 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-4bf89a46-4c49-474f-bccd-1639db9c2e9d req-180486a8-b072-4499-bad2-2b4ceab0e22e tempest-TestShelveInstance-1712606706 None] Connection info returned from driver {'name': 'volumes/volume-10086bb1-c0f6-49c3-9b03-c394a4123d60', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '10086bb1-c0f6-49c3-9b03-c394a4123d60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8cea3839-74ce-41c7-984a-34488ae707b5'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 22:07:01.688402 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-4bf89a46-4c49-474f-bccd-1639db9c2e9d req-180486a8-b072-4499-bad2-2b4ceab0e22e tempest-TestShelveInstance-1712606706 None] attachment_update completed successfully.
Oct 29 22:07:04.909991 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=7,cinder:SELECT=31,cinder:INSERT=7,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:07:24.917346 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=7,cinder:SELECT=30,cinder:INSERT=5 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:07:34.929601 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:07:44.929163 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:08:01.497599 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:08:01.498259 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:08:01.521777 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:08:01.545158 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:08:04.927637 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:08:14.937986 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:08:34.938380 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:08:54.945588 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:09:01.500210 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:09:01.500902 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:09:01.525700 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:09:01.555854 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:09:14.952374 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:09:24.958282 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:09:30.780415 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-90b1a86a-75d9-4601-bfbb-a5a3ba28551e req-1dd42dcc-a5f0-44fb-8155-d8b8d66a3da8 tempest-TestShelveInstance-1712606706 None] Terminate volume connection completed successfully.
Oct 29 22:09:30.781026 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-90b1a86a-75d9-4601-bfbb-a5a3ba28551e req-1dd42dcc-a5f0-44fb-8155-d8b8d66a3da8 tempest-TestShelveInstance-1712606706 None] Deleting attachment 8cea3839-74ce-41c7-984a-34488ae707b5. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 22:09:32.162080 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-2b5d8ec5-4c29-49b0-949d-62b049c5b538 req-d43a2da9-d687-4dc5-adf4-546fe571710e tempest-TestShelveInstance-1712606706 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Oct 29 22:09:32.891648 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_concurrency.processutils [req-2b5d8ec5-4c29-49b0-949d-62b049c5b538 req-d43a2da9-d687-4dc5-adf4-546fe571710e tempest-TestShelveInstance-1712606706 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.729s {{(pid=131780) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Oct 29 22:09:32.892498 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-2b5d8ec5-4c29-49b0-949d-62b049c5b538 req-d43a2da9-d687-4dc5-adf4-546fe571710e tempest-TestShelveInstance-1712606706 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-10086bb1-c0f6-49c3-9b03-c394a4123d60', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '2134f18b-29f2-4f2c-b4ab-e6816d91d1d7', 'volume_id': '10086bb1-c0f6-49c3-9b03-c394a4123d60', 'discard': True}} {{(pid=131780) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1783}}
Oct 29 22:09:32.916789 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-2b5d8ec5-4c29-49b0-949d-62b049c5b538 req-d43a2da9-d687-4dc5-adf4-546fe571710e tempest-TestShelveInstance-1712606706 None] Connection info returned from driver {'name': 'volumes/volume-10086bb1-c0f6-49c3-9b03-c394a4123d60', 'hosts': ['10.222.0.36'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '10086bb1-c0f6-49c3-9b03-c394a4123d60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f5e22ee4-1d9d-44f4-819e-9cd137efb596'} {{(pid=131780) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Oct 29 22:09:32.963114 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-2b5d8ec5-4c29-49b0-949d-62b049c5b538 req-d43a2da9-d687-4dc5-adf4-546fe571710e tempest-TestShelveInstance-1712606706 None] attachment_update completed successfully.
Oct 29 22:09:44.972642 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=18,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:09:54.972094 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:10:01.503035 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:10:01.503888 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:10:01.530971 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:10:01.555908 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:10:04.979138 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:10:24.975363 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:10:34.979583 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:10:54.989503 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:11:01.502744 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:11:01.503409 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:11:01.526935 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:11:01.550570 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:11:04.998254 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:11:07.726103 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-521afc30-2574-477d-8dc2-7de627b11417 req-3cf1bcff-a76b-4472-9451-6efd9a35e415 tempest-TestShelveInstance-1712606706 None] Terminate volume connection completed successfully.
Oct 29 22:11:07.726643 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.manager [req-521afc30-2574-477d-8dc2-7de627b11417 req-3cf1bcff-a76b-4472-9451-6efd9a35e415 tempest-TestShelveInstance-1712606706 None] Deleting attachment f5e22ee4-1d9d-44f4-819e-9cd137efb596. {{(pid=131780) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Oct 29 22:11:07.873732 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-521afc30-2574-477d-8dc2-7de627b11417 req-87553d0f-4a71-45b3-a475-d0e8819a71c5 tempest-TestShelveInstance-1712606706 None] Acquiring lock "cinder-10086bb1-c0f6-49c3-9b03-c394a4123d60-delete_volume" by "delete_volume" {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Oct 29 22:11:07.886453 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-521afc30-2574-477d-8dc2-7de627b11417 req-87553d0f-4a71-45b3-a475-d0e8819a71c5 tempest-TestShelveInstance-1712606706 None] Lock "cinder-10086bb1-c0f6-49c3-9b03-c394a4123d60-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Oct 29 22:11:07.929306 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-521afc30-2574-477d-8dc2-7de627b11417 req-87553d0f-4a71-45b3-a475-d0e8819a71c5 tempest-TestShelveInstance-1712606706 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:11:08.039257 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-521afc30-2574-477d-8dc2-7de627b11417 req-87553d0f-4a71-45b3-a475-d0e8819a71c5 tempest-TestShelveInstance-1712606706 None] volume has no backup snaps {{(pid=131780) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}}
Oct 29 22:11:08.046726 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-521afc30-2574-477d-8dc2-7de627b11417 req-87553d0f-4a71-45b3-a475-d0e8819a71c5 tempest-TestShelveInstance-1712606706 None] deleting rbd volume volume-10086bb1-c0f6-49c3-9b03-c394a4123d60 {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1415}}
Oct 29 22:11:08.270061 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-521afc30-2574-477d-8dc2-7de627b11417 req-87553d0f-4a71-45b3-a475-d0e8819a71c5 tempest-TestShelveInstance-1712606706 None] volume is a clone so cleaning references {{(pid=131780) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1436}}
Oct 29 22:11:08.298121 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-521afc30-2574-477d-8dc2-7de627b11417 req-87553d0f-4a71-45b3-a475-d0e8819a71c5 tempest-TestShelveInstance-1712606706 None] deleting parent snapshot volume-10086bb1-c0f6-49c3-9b03-c394a4123d60.clone_snap {{(pid=131780) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1329}}
Oct 29 22:11:09.282064 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.quota [req-521afc30-2574-477d-8dc2-7de627b11417 req-87553d0f-4a71-45b3-a475-d0e8819a71c5 tempest-TestShelveInstance-1712606706 None] Created reservations ['72fa5057-6ff8-4e3a-a8ca-98156a35f956', 'c27a228d-4552-4520-934f-6c80185c994f', 'fc4e86f3-5104-4254-952c-023c381e21a4', 'd8552123-8c9a-448d-97b5-9515a72323f0'] {{(pid=131780) reserve /opt/stack/cinder/cinder/quota.py:755}}
Oct 29 22:11:09.336371 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-521afc30-2574-477d-8dc2-7de627b11417 req-87553d0f-4a71-45b3-a475-d0e8819a71c5 tempest-TestShelveInstance-1712606706 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:11:09.367875 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [req-521afc30-2574-477d-8dc2-7de627b11417 req-87553d0f-4a71-45b3-a475-d0e8819a71c5 tempest-TestShelveInstance-1712606706 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:11:09.400993 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [req-521afc30-2574-477d-8dc2-7de627b11417 req-87553d0f-4a71-45b3-a475-d0e8819a71c5 tempest-TestShelveInstance-1712606706 None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:11:09.405182 ncdv-master-1 cinder-volume[131780]: INFO cinder.volume.manager [req-521afc30-2574-477d-8dc2-7de627b11417 req-87553d0f-4a71-45b3-a475-d0e8819a71c5 tempest-TestShelveInstance-1712606706 None] Deleted volume successfully.
Oct 29 22:11:09.417979 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.coordination [req-521afc30-2574-477d-8dc2-7de627b11417 req-87553d0f-4a71-45b3-a475-d0e8819a71c5 tempest-TestShelveInstance-1712606706 None] Lock "cinder-10086bb1-c0f6-49c3-9b03-c394a4123d60-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=131780) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Oct 29 22:11:25.004520 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=17,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:11:35.015668 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=20,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:11:45.012190 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:12:01.506607 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:12:01.507260 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:12:01.531175 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:12:01.555382 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:12:15.017430 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:12:15.024579 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:12:35.024995 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:12:45.030349 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:13:01.510816 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:13:01.511442 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:13:01.535316 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:13:01.559538 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:13:05.038812 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:13:15.040785 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:13:35.047766 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:13:45.052988 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:14:01.514499 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:14:01.515598 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:14:01.553105 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:14:01.590160 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:14:05.061897 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:14:15.070701 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:14:35.067716 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:14:35.074762 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:14:55.077359 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:15:01.519889 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:15:01.520516 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:15:01.546939 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:15:01.570364 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:15:05.081167 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:15:25.090900 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:15:35.093678 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:15:55.101469 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:16:01.515751 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:16:01.516822 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:16:01.539757 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:16:01.562915 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:16:05.106299 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:16:25.114555 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:16:45.125319 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:16:55.123871 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:17:01.518098 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:17:01.518723 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:17:01.542198 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:17:01.565954 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:17:15.127438 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:17:25.130650 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:17:45.138769 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:18:01.520699 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:18:01.521308 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:18:01.545245 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:18:01.567967 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:18:05.137611 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:18:15.141916 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:18:35.147777 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:18:45.156934 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:19:01.524055 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:19:01.524738 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:19:01.547676 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:19:01.571991 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:19:05.161742 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:19:15.168142 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:19:35.175659 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:19:45.180112 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:20:01.528249 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:20:01.528906 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:20:01.552438 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:20:01.575537 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:20:05.185513 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:20:05.187037 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:20:25.193902 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:20:35.202004 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:20:55.206590 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:21:01.530863 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:21:01.531461 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:21:01.554993 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:21:01.583252 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:21:05.211514 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:21:15.220914 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:21:35.227421 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:21:45.231837 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:22:01.528473 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:22:01.529080 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:22:01.551989 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:22:01.575954 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:22:05.231872 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:22:25.240055 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:22:35.245377 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:22:55.254314 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:23:01.530968 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:23:01.531578 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:23:01.555328 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:23:01.579067 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:23:05.261307 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:23:25.266399 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:23:35.270467 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:23:55.278074 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:24:05.287562 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:24:25.290480 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:24:35.294200 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:24:45.304431 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:24:55.308592 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:25:01.535610 ncdv-master-1 cinder-volume[131780]: DEBUG oslo_service.periodic_task [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=131780) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Oct 29 22:25:01.536224 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:25:01.561414 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.volume.drivers.rbd [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=131780) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:586}}
Oct 29 22:25:01.584161 ncdv-master-1 cinder-volume[131780]: DEBUG cinder.manager [None req-1681fc5e-0d60-459e-bb26-671fd53ed904 None None] Notifying Schedulers of capabilities ... {{(pid=131780) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Oct 29 22:25:15.312152 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Oct 29 22:25:25.316561 ncdv-master-1 cinder-volume[131780]: DEBUG dbcounter [-] [131780] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=131780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}